Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

去掉对higo_uuid的列，一点用途都没有了。 #99

Open
muyannian opened this issue Jun 21, 2013 · 1 comment
Open

去掉对higo_uuid的列，一点用途都没有了。 #99

muyannian opened this issue Jun 21, 2013 · 1 comment
Labels
bug

Comments

@muyannian
Copy link
Owner

Task Logs: 'attempt_201305301235_3962587_r_000002_0'

stdout logs

skipdocument: {userid_s=1009819479, pv1_s=31, pv2_s=3115},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009827894, pv1_s=31, pv2_s=1134},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009829838, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009836795, pv1_s=31, pv2_s=230},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009837596, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009838748, pv1_s=31, pv2_s=12},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009846569, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009850988, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009851798, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009855929, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009858827, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009862985, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009865955, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009865973, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009865991, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009867467, pv1_s=31, pv2_s=509},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009867665, pv1_s=31, pv2_s=110},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009867674, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009868961, pv1_s=31, pv2_s=238},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009869087, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009873875, pv1_s=31, pv2_s=236},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009874568, pv1_s=31, pv2_s=4010},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009874658, pv1_s=31, pv2_s=16},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009875846, pv1_s=31, pv2_s=1969},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009876557, pv1_s=31, pv2_s=109},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009876872, pv1_s=31, pv2_s=109},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009876908, pv1_s=31, pv2_s=23},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009878636, pv1_s=31, pv2_s=1652},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009883775, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009886259, pv1_s=0, pv2_s=_},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009893774, pv1_s=31, pv2_s=194},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009893909, pv1_s=31, pv2_s=888},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009894287, pv1_s=0, pv2_s=_},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009894467, pv1_s=0, pv2_s=_},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009895574, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009895925, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009896528, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009897662, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009898382, pv1_s=31, pv2_s=7},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009898760, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009899363, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009899624, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at com.alipay.higo.hadoop.job.DocumentConverter.convert(DocumentConverter.java:47)
at com.alipay.higo.hadoop.job.DocumentList.transDodument(DocumentList.java:57)
at com.alipay.higo.hadoop.job.DocumentList.toRamWriter(DocumentList.java:41)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:101)
at com.alipay.higo.hadoop.job.IndexReducer.reduce(IndexReducer.java:14)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:176)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:545)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:408)
at org.apache.hadoop.mapred.Child.main(Child.java:165)

skipdocument: {userid_s=1009899921, pv1_s=31, pv2_s=0},org.apache.solr.common.SolrException: [doc=null] missing required field: higo_uuid
at org.apache.solr.update.DocumentBuilder.toDocument(DocumentBuilder.java:346)
at
@muyannian
Copy link
Owner Author 

// Now validate required fields or add default values
// fields with default values are defacto 'required'
for (SchemaField field : schema.getRequiredFields()) {
  if (out.getFieldable(field.getName() ) == null) {
    if (field.getDefaultValue() != null) {
      addField(out, field, field.getDefaultValue(), 1.0f);
    } 
    else {

// String msg = getID(doc, schema) + "missing required field: " + field.getName();
// throw new SolrException( SolrException.ErrorCode.BAD_REQUEST, msg );
}
}
}
return out;
}

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@muyannian