Discussion:
Best configuration for 512MB RAM?
Tom Maiaroto
2014-10-20 19:18:49 UTC
Permalink
I'm running InfluxDB on a very small server. I have a few other processes
running, but nothing crazy.
What would the best settings be for small servers?

I noticed sometimes InfluxDB is not running and I can't find any reasoning
in the logs. So I figured it was running out of memory.
I haven't profiled, but will set something up.

In general though, are there any good approximations I can use in the
config?
ie. multiple this number of open files by available memory and that will
give you the max open files.... etc.

Aside from max-open-files ... are there any other settings to tweak?

What about LRU cache size?

Any tips would be great, thanks!
Also, is there a minimum amount of RAM suggested for running InfluxDB?
--
You received this message because you are subscribed to the Google Groups "InfluxDB" group.
To unsubscribe from this group and stop receiving emails from it, send an email to influxdb+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/influxdb.
To view this discussion on the web visit https://groups.google.com/d/msgid/influxdb/401e208c-ebb5-4f49-8ca0-a975eaf449f3%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
p***@gmail.com
2014-10-21 23:34:40 UTC
Permalink
I'm running InfluxDB (default config plus the graphite input plugin) and a collectd daemon and some other stuff on one 512MB cloud server and so far so good. The influxdb daemon also receives system metrics data from 2 other cloud servers running collectd.

The influxdb daemon uses +-60MB memory.
--
You received this message because you are subscribed to the Google Groups "InfluxDB" group.
To unsubscribe from this group and stop receiving emails from it, send an email to influxdb+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/influxdb.
To view this discussion on the web visit https://groups.google.com/d/msgid/influxdb/a8eb7470-3d99-4169-9bec-1b960f27d5a4%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Tom Maiaroto
2014-10-21 23:46:42 UTC
Permalink
Hmmm, well I'm using Go... Maybe I should use some Http Client other than
the default. Maybe something is being left open even.

I'm still curious about what the settings would do and if any would help.
I'm assuming 512MB was not the target amount of RAM for the database and
those settings are based on having more, no?
Post by Tom Maiaroto
I'm running InfluxDB on a very small server. I have a few other processes
running, but nothing crazy.
What would the best settings be for small servers?
I noticed sometimes InfluxDB is not running and I can't find any reasoning
in the logs. So I figured it was running out of memory.
I haven't profiled, but will set something up.
In general though, are there any good approximations I can use in the
config?
ie. multiple this number of open files by available memory and that will
give you the max open files.... etc.
Aside from max-open-files ... are there any other settings to tweak?
What about LRU cache size?
Any tips would be great, thanks!
Also, is there a minimum amount of RAM suggested for running InfluxDB?
--
You received this message because you are subscribed to the Google Groups "InfluxDB" group.
To unsubscribe from this group and stop receiving emails from it, send an email to influxdb+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at http://groups.google.com/group/influxdb.
To view this discussion on the web visit https://groups.google.com/d/msgid/influxdb/76c6b30c-efee-4bb1-a60a-c92ebae773cf%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Heath Raftery
2017-01-11 05:56:53 UTC
Permalink
Bump. A reasonable query I think, because running with 512MB opens up a
whole different universe of hosts for users with simple requirements.

My experience is with a default install of influxdb 1.1.1, grafana 4.0.2
and kapacitor 1.1.1. Points arrive via HTTP at about 2500/day. There's two
databases with series cardinality of 21 and 1 (the latter is for grafana
annotations), plus the _internal database with 188. Other than manual
viewing of data with grafana, the only other non-default queries are made
by a kapacitor script that processes the stream from one measurement and
writes to another.

I'm running with 512MB, and every week or so Influx quietly dies, with an
OOM message left in syslog. Runs perfectly fine on restart, with about
150MB free (as reported by free -m).

Given how outrageously far I am from sweating influxdb's capabilities (the
hardware sizing guidelines start at series cardinality of 100,000), it
seems there ought to be a configuration that will happily run on 512MB.

Rolf, your results are impressive. Have you noticed much change over time?

Heath
Post by Tom Maiaroto
I'm running InfluxDB on a very small server. I have a few other processes
running, but nothing crazy.
What would the best settings be for small servers?
I noticed sometimes InfluxDB is not running and I can't find any reasoning
in the logs. So I figured it was running out of memory.
I haven't profiled, but will set something up.
In general though, are there any good approximations I can use in the
config?
ie. multiple this number of open files by available memory and that will
give you the max open files.... etc.
Aside from max-open-files ... are there any other settings to tweak?
What about LRU cache size?
Any tips would be great, thanks!
Also, is there a minimum amount of RAM suggested for running InfluxDB?
--
Remember to include the version number!
---
You received this message because you are subscribed to the Google Groups "InfluxData" group.
To unsubscribe from this group and stop receiving emails from it, send an email to influxdb+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at https://groups.google.com/group/influxdb.
To view this discussion on the web visit https://groups.google.com/d/msgid/influxdb/51bdc618-2447-4b95-bd96-4b759d92bcaa%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
r***@gmail.com
2017-01-11 07:56:12 UTC
Permalink
Post by Heath Raftery
Rolf, your results are impressive. Have you noticed much change over time?
The system is stable over time. The metrics server is restarted once a week for an offline backup.

We are using the db since 2014 and we recently upgraded Grafana V2.0 to V4.x and InfluxDB V0.8 to V1.1.1 and it still works fine on that 512MB box.

It currently collects 200 server telemetry metrics from each of the 5 cloud servers at 10 seconds intervals, and 25 functional metrics for airport take-off and landing metrics at 30 seconds intervals.

--
Rolf
--
Remember to include the version number!
---
You received this message because you are subscribed to the Google Groups "InfluxData" group.
To unsubscribe from this group and stop receiving emails from it, send an email to influxdb+***@googlegroups.com.
To post to this group, send email to ***@googlegroups.com.
Visit this group at https://groups.google.com/group/influxdb.
To view this discussion on the web visit https://groups.google.com/d/msgid/influxdb/f7007327-483e-40d7-9e59-910119b1d661%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
Loading...