Error while step "storage": "SSL SYSCALL error: EOF detected"

[Anton Kirillov]

Hello Snowplow Team.

Sometimes we have an error while "4-storage" — "SSL SYSCALL error: EOF detected". 

What it means for us? How can we fix it?

Details:

(/snowplow/4-storage)$ bundle exec bin/snowplow-storage-loader --config=config/redshift.yml

Loading Snowplow events and shredded types into Redshift cluster...

INFO:  Load into table 'events' completed...

INFO:  Load into table 'com_contexts_global_1' completed...

INFO:  Load into table 'com_events_custom_1' completed...

INFO:  Load into table 'org_w3_performance_timing_1' completed...

PG::Error error executing COPY and ANALYZE statements: BEGIN;

COPY atomic.events FROM ...;

COPY atomic.com_events_custom_1 FROM ...;

COPY atomic.org_w3_performance_timing_1 FROM ...;

ANALYZE atomic.events;

ANALYZE atomic.com_contexts_global_1;

ANALYZE atomic.com_events_custom_1;

ANALYZE atomic.org_w3_performance_timing_1;

COMMIT;: SSL SYSCALL error: EOF detected

[Anton Kirillov]

And the second question: what if ANALYZE takes very long time? It takes much more time as compared with EMR+COPY, because we have huge amount of events in atomic.events.

[Alex Dean]

Hi Anton,

A SSL SYSCALL error: EOF detected typically means that there was some kind of network issue while the query was running, or (less likely) there was some kind of outage/reboot of the Redshift cluster. SSL SYSCALL error: EOF detected is pretty rare if you're running StorageLoader from EC2, but yes it can happen.

On the ANALYZE: in fact it should technically be done after your vacuum, not before: https://github.com/snowplow/snowplow/issues/1361

If you are consistently getting SSL SYSCALL error: EOF, you may want to --skip analyze and run vacuum&analyze as a separate process, making sure not to clash with your event loads; you could run it e.g. over weekends.

Cheers,

Alex

--
You received this message because you are subscribed to the Google Groups "Snowplow" group.
To unsubscribe from this group and stop receiving emails from it, send an email to snowplow-use...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

--

Co-founder
Snowplow Analytics
The Roma Building, 32-38 Scrutton Street, London EC2A 4RQ, United Kingdom
+44 (0)203 589 6116
+44 7881 622 925
@alexcrdean