Does fluentd meets this need.

[Moez Hajiri]

Good day everyone , 

Currently I am working on a project of developing a dashboard consuming data from ElasticSearch , Elasticsearch is beeing feeded through python scripts that gathers these information from web applications in the form of either json or csv files. These scripts are run via cron on a daily basis. So my question here is whether I can use fluentd to replace these scripts. So can Fluentd collect information ( detect if they are new or not cause some of these files are not timestamped ) and output them to elasticSearch.

Thank you everyone.

[Mr. Fiber]

If you want to collect logs from local file in streaming manner,

you can use in_tail plugin for it.

Masahiro

--
You received this message because you are subscribed to the Google Groups "Fluentd Google Group" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fluentd+unsubscribe@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Moez Hajiri]

Thank your for taking some time to answer me , actually some of the files are local and some of them are accessible via URLs (ie: https://www.example.com/file.txt).

--
You received this message because you are subscribed to a topic in the Google Groups "Fluentd Google Group" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fluentd/9WyviF1M19Q/unsubscribe.
To unsubscribe from this group and all its topics, send an email to fluentd+unsubscribe@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

	Moez HAJIRI Engineering student | Higher institute of computer science (ISI Ariana)
	M: (+216)93 647 987 E: hajir...@gmail.com
	6 sabkha street, appartment 6

[Mr. Fiber]

> ome of them are accessible via URLs (ie: https://www.example.com/file.txt).

fluentd core doesn't provide plugin for it.

So you may need to implement plugin for remote endpoints or use in_exec with custom script.

Masahiro