Logstash-Output-Webhdfs

3011 단어 elk
어쩔 수 없이, 때로는 문제를 해결하기 위해 답을 찾지만, 해결된 후에는 필기를 하는 것을 잊어버리고...이번에는 혼내줘서...[WARN ][logstash.outputs.webhdfs ] Failed to flush outgoing items {:outgoing_count=>500, :exception=>”WebHDFS::ServerError”, :backtrace=>[“/opt/logstash-5.4.1/vendor/bundle/jruby/1.9/gems/webhdfs-0.8.0/lib/webhdfs/client_v1.rb:351:in request'", "/opt/logstash-5.4.1/vendor/bundle/jruby/1.9/gems/webhdfs-0.8.0/lib/webhdfs/client_v1.rb:270:in operate_requests’”, “/opt/logstash-5.4.1/vendor/bundle/jruby/1.9/gems/webhdfs-0.8.0/lib/webhdfs/client_v1.rb:73:in create'", "/opt/logstash-5.4.1/vendor/bundle/jruby/1.9/gems/logstash-output-webhdfs-3.0.2/lib/logstash/outputs/webhdfs.rb:211:in write_data’”, “/opt/logstash-5.4.1/vendor/bundle/jruby/1.9/gems/logstash-output-webhdfs-3.0.2/lib/logstash/outputs/webhdfs.rb:195:in flush'", "org/jruby/RubyHash.java:1342:in each’”, “/opt/logstash-5.4.1/vendor/bundle/jruby/1.9/gems/logstash-output-webhdfs-3.0.2/lib/logstash/outputs/webhdfs.rb:183:in flush'", "/opt/logstash-5.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.22/lib/stud/buffer.rb:219:in buffer_flush’”, “org/jruby/RubyHash.java:1342:in each'", "/opt/logstash-5.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.22/lib/stud/buffer.rb:216:in buffer_flush’”, “/opt/logstash-5.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.22/lib/stud/buffer.rb:193:in buffer_flush'", "/opt/logstash-5.4.1/vendor/bundle/jruby/1.9/gems/stud-0.0.22/lib/stud/buffer.rb:159:in buffer_receive’”, “/opt/logstash-5.4.1/vendor/bundle/jruby/1.9/gems/logstash-output-webhdfs-3.0.2/lib/logstash/outputs/webhdfs.rb:166:in receive'", "/opt/logstash-5.4.1/logstash-core/lib/logstash/outputs/base.rb:92:in multi_receive’”, “org/jruby/RubyArray.java:1613:in each'", "/opt/logstash-5.4.1/logstash-core/lib/logstash/outputs/base.rb:92:in multi_receive’”, “/opt/logstash-5.4.1/logstash-core/lib/logstash/output_delegator_strategies/legacy.rb:22:in multi_receive'", "/opt/logstash-5.4.1/logstash-core/lib/logstash/output_delegator.rb:47:in multi_receive’”, “/opt/logstash-5.4.1/logstash-core/lib/logstash/pipeline.rb:407:in output_batch'", "org/jruby/RubyHash.java:1342:in each’”, “/opt/logstash-5.4.1/logstash-core/lib/logstash/pipeline.rb:406:in output_batch'", "/opt/logstash-5.4.1/logstash-core/lib/logstash/pipeline.rb:352:in worker_loop’”, “/opt/logstash-5.4.1/logstash-core/lib/logstash/pipeline.rb:317:in `start_workers’”]}

반나절을 생각하면hdfs는 문제가 있을 수 없습니다. 온라인상에서 계속 달리고 있습니다. 원래 웹hdfs의 설정에서user는 반드시 기입할 필요가 없습니다. 반나절을 거슬러 올라가다가 결과를 찾지 못해 인터넷을 찾았습니다. 드디어 답을 찾았습니다. 해결했습니다. 마음대로 필기를 하세요.

webhdfs
user: hdfs 
 logstash /etc/hosts hdfs 
 :http://stackmirror.cn/page/s1b6a4mbbvas

좋은 웹페이지 즐겨찾기