sqoop으로 hdfs를 mysql에 전송하여 오류를 보고합니다: ERROR mapreduce.ExportJobBase: Export job failed! 2020-07-21 20:38:06,879 ERROR
19645 단어 오보를 모아 모으다sqoop
2020-07-21 20:37:36,781 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1595291661620_0009
2020-07-21 20:37:36,781 INFO mapreduce.JobSubmitter: Executing with tokens: []
2020-07-21 20:37:37,301 INFO conf.Configuration: resource-types.xml not found
2020-07-21 20:37:37,302 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
2020-07-21 20:37:37,509 INFO impl.YarnClientImpl: Submitted application application_1595291661620_0009
2020-07-21 20:37:37,582 INFO mapreduce.Job: The url to track the job: http://node7-1:8088/proxy/application_1595291661620_0009/
2020-07-21 20:37:37,583 INFO mapreduce.Job: Running job: job_1595291661620_0009
2020-07-21 20:37:49,086 INFO mapreduce.Job: Job job_1595291661620_0009 running in uber mode : false
2020-07-21 20:37:49,090 INFO mapreduce.Job: map 0% reduce 0%
2020-07-21 20:38:04,405 INFO mapreduce.Job: map 25% reduce 0%
2020-07-21 20:38:05,542 INFO mapreduce.Job: map 100% reduce 0%
2020-07-21 20:38:06,581 INFO mapreduce.Job: Job job_1595291661620_0009 failed with state FAILED due to: Task failed task_1595291661620_0009_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0 killedMaps:0 killedReduces: 0
2020-07-21 20:38:06,836 INFO mapreduce.Job: Counters: 13
Job Counters
Failed map tasks=1
Killed map tasks=3
Launched map tasks=4
Other local map tasks=1
Data-local map tasks=3
Total time spent by all maps in occupied slots (ms)=50529
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=50529
Total vcore-milliseconds taken by all map tasks=50529
Total megabyte-milliseconds taken by all map tasks=51741696
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
2020-07-21 20:38:06,857 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
2020-07-21 20:38:06,863 INFO mapreduce.ExportJobBase: Transferred 0 bytes in 38.3936 seconds (0 bytes/sec)
2020-07-21 20:38:06,871 INFO mapreduce.ExportJobBase: Exported 0 records.
2020-07-21 20:38:06,872 ERROR mapreduce.ExportJobBase: Export job failed!
2020-07-21 20:38:06,879 ERROR tool.ExportTool: Error during export:
Export job failed!
at org.apache.sqoop.mapreduce.ExportJobBase.runExport(ExportJobBase.java:445)
at org.apache.sqoop.manager.SqlManager.exportTable(SqlManager.java:931)
at org.apache.sqoop.tool.ExportTool.exportTable(ExportTool.java:80)
at org.apache.sqoop.tool.ExportTool.run(ExportTool.java:99)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:234)
at org.apache.sqoop.Sqoop.runTool(Sqoop.java:243)
at org.apache.sqoop.Sqoop.main(Sqoop.java:252)
해결 방법
이 내용에 흥미가 있습니까?
현재 기사가 여러분의 문제를 해결하지 못하는 경우 AI 엔진은 머신러닝 분석(스마트 모델이 방금 만들어져 부정확한 경우가 있을 수 있음)을 통해 가장 유사한 기사를 추천합니다:
Hadoop AWS EC2에 sqoop 설치전제 조건: hadoop 설치 방법 이전 가이드에서 이미 OpenJDK 1.8과 함께 Hadoop을 설치했습니다. 이후 버전의 MySql 서버가 JDK 1.7 MySql 커넥터 드라이버와 제대로 작동하지 않기 때문에...
텍스트를 자유롭게 공유하거나 복사할 수 있습니다.하지만 이 문서의 URL은 참조 URL로 남겨 두십시오.
CC BY-SA 2.5, CC BY-SA 3.0 및 CC BY-SA 4.0에 따라 라이센스가 부여됩니다.