Unable to run web example

[Andrew Gardner]

Iago: Latest Master
Java: Java(TM) SE Runtime Environment (build 1.7.0_71-b14)
Scala: Scala code runner version 2.11.1 -- Copyright 2002-2013, LAMP/EPFL
OS: Centos 6.5 (running under Vagrant with sufficient RAM)

Followed ..\web\README.md.
Everything builds fine via Maven.

Ran this command "java -jar iago-0.6.8.jar -f ../config/web.scala".

And it always gets this far:

DEBUG com.twitter.parrot.util 16:24:15.971 logging to console enabled
INFO com.twitter.parrot.launcher 16:24:15.974 Starting Parrot job named web
DEBUG com.twitter.parrot.launcher 16:24:15.975 Creating scripts.
DEBUG com.twitter.parrot.launcher 16:24:15.977 opening resource: /scripts/common.sh
DEBUG com.twitter.parrot.launcher 16:24:15.989 opening resource: /scripts/local-parrot.sh
DEBUG com.twitter.parrot.launcher 16:24:15.991 opening resource: /scripts/parrot-feeder.sh
DEBUG com.twitter.parrot.launcher 16:24:15.995 opening resource: /scripts/parrot-server.sh
DEBUG com.twitter.parrot.launcher 16:24:15.997 Creating configs.
DEBUG com.twitter.parrot.launcher 16:24:15.998 opening resource: /templates/template-server.scala.in
DEBUG com.twitter.parrot.launcher 16:24:18.066 opening resource: /templates/template-feeder.scala.in
sh scripts/local-parrot.sh

That's where it hangs.
Checked parrot-feeder.log and I get this:

 INF [20150107-16:24:33.991] stats: Starting LatchedStatsListener
700 [20150107-16:24:34.019] net: HttpServer created http 0.0.0.0/0.0.0.0:9900
700 [20150107-16:24:34.030] net: context created: /
700 [20150107-16:24:34.034] net: context created: /report/
700 [20150107-16:24:34.035] net: context created: /favicon.ico
700 [20150107-16:24:34.042] net: context created: /static
700 [20150107-16:24:34.043] net: context created: /pprof/heap
700 [20150107-16:24:34.051] net: context created: /pprof/profile
700 [20150107-16:24:34.052] net: context created: /pprof/contention
700 [20150107-16:24:34.057] net: context created: /tracing
700 [20150107-16:24:34.059] net: context created: /health
700 [20150107-16:24:34.059] net: context created: /quitquitquit
700 [20150107-16:24:34.059] net: context created: /abortabortabort
700 [20150107-16:24:34.076] net: context created: /graph/
700 [20150107-16:24:34.077] net: context created: /graph_data
INF [20150107-16:24:34.078] stats: Starting JsonStatsLogger
INF [20150107-16:24:34.079] admin: Starting TimeSeriesCollector
INF [20150107-16:24:34.080] admin: Admin HTTP interface started on port 9900.
INF [20150107-16:24:34.090] feeder: Starting Parrot Feeder...
INF [20150107-16:24:34.098] feeder: Starting ParrotPoller
INF [20150107-16:24:34.099] util: Connecting to Parrots
INF [20150107-16:24:34.105] util: Connecting to parrot server at localhost:9999
DEB [20150107-16:24:34.860] nio: Using select timeout of 500
DEB [20150107-16:24:34.862] nio: Epoll-bug workaround enabled = false
INF [20150107-16:24:34.912] finagle: Finagle version 6.11.1 (rev=83de11a66b498351418433bcad00cbf4b7dc495c) built at 20140122-140449
INF [20150107-16:24:35.169] feeder: Awaiting 1 servers to stand up and be recognized.
ERR [20150107-16:24:36.513] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
TRA [20150107-16:24:36.532] util: RemoteParrot: setting rate 1
ERR [20150107-16:24:36.547] admin: Spawned thread background (Thread[background,5,main]) died with a terminal exception
ERR [20150107-16:24:36.547] admin: com.twitter.finagle.FailedFastException
ERR [20150107-16:24:36.547] admin:     at com.twitter.finagle.NoStacktrace(Unknown Source)
ERR [20150107-16:24:37.515] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:38.517] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:39.520] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:40.523] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:41.525] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:42.526] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:43.529] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:44.535] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:45.537] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:46.539] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:47.541] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:48.543] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:49.545] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:50.547] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:51.549] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:52.551] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:53.552] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:54.559] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:55.561] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:56.564] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:57.565] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:58.570] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:24:59.574] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
ERR [20150107-16:25:00.575] feeder: Exception polling parrot[localhost:9999] - com.twitter.finagle.FailedFastException
INF [20150107-16:25:01.081] stats: {"jvm_buffer_direct_count":2,"jvm_buffer_direct_max":131072,"jvm_buffer_direct_used":131072,"jvm_buffer_mapped_count":0,"jvm_buffer_mapped_max":0,"jvm_buffer_mapped_used":0,"jvm_current_mem_CMS_Old_Gen_max":1291845632,"jvm_current_mem_CMS_Old_Gen_used":0,"jvm_current_mem_CMS_Perm_Gen_max":67108864,"jvm_current_mem_CMS_Perm_Gen_used":25070152,"jvm_current_mem_Code_Cache_max":50331648,"jvm_current_mem_Code_Cache_used":1758656,"jvm_current_mem_Eden_Space_max":429522944,"jvm_current_mem_Eden_Space_used":67123432,"jvm_current_mem_Survivor_Space_max":53673984,"jvm_current_mem_Survivor_Space_used":28207848,"jvm_current_mem_used":122160088,"jvm_fd_count":125,"jvm_fd_limit":4096,"jvm_gc_ConcurrentMarkSweep_cycles":0,"jvm_gc_ConcurrentMarkSweep_msec":0,"jvm_gc_Copy_cycles":1,"jvm_gc_Copy_msec":93,"jvm_gc_cycles":1,"jvm_gc_msec":93,"jvm_heap_committed":1775042560,"jvm_heap_max":1775042560,"jvm_heap_used":95331280,"jvm_nonheap_committed":27525120,"jvm_nonheap_max":117440512,"jvm_nonheap_used":26828808,"jvm_num_cpus":1,"jvm_post_gc_CMS_Old_Gen_max":1291845632,"jvm_post_gc_CMS_Old_Gen_used":0,"jvm_post_gc_CMS_Perm_Gen_max":67108864,"jvm_post_gc_CMS_Perm_Gen_used":0,"jvm_post_gc_Eden_Space_max":429522944,"jvm_post_gc_Eden_Space_used":0,"jvm_post_gc_Survivor_Space_max":53673984,"jvm_post_gc_Survivor_Space_used":28207848,"jvm_post_gc_used":28207848,"jvm_start_time":1420647861511,"jvm_thread_count":16,"jvm_thread_daemon_count":10,"jvm_thread_peak_count":17,"jvm_uptime":39505,"service":"parrot-feeder","source":"localhost","timestamp":1420647901}

Not really sure where to go from here.

Suggestions?

Cheers,
Andrew

 

[Tom Howland]

It looks like the parrot server never started. Try running

sh -evx scripts/local-parrot.sh

--

---
You received this message because you are subscribed to the Google Groups "Iago Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to iago-users+...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Andrew Gardner]

Seems to have lost my reply...

But aye, tried running sh -evc scripts/local-parrot.sh and got this:

sh scripts/parrot-server.sh start-local &
sleep 3
+ sleep 3
+ sh scripts/parrot-server.sh start-local
/opt/jdk1.7.0_71/bin/java -server -XX:+UseConcMarkSweepGC -verbosegc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+UseParNewGC -Xloggc:gc-server.log -Xmx4000m -Xms4000m -XX:NewSize=512m com.twitter.parrot.server.ServerMain -f config/target/parrot-server.scala
Error occurred during initialization of VM
Could not reserve enough space for object heap
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.

The VM (Centos 6.5/Virtualbox) I'm running has been given plenty of RAM.
The Java distribution I'm using is just the latest Oracle.
Feels like it might be Java's fault somehow though...
 

[Tom Howland]

Try running the script again but with the "-Xmx4000m -Xms4000m -XX:NewSize=512m" part removed. If that works, you can adjust memory requirements with flags in your launcher config or you can run on a machine with more RAM available.

[Tom Howland]

The memory flags generated are by default way larger than what most people need, by the way.

[Andrew Gardner]

Ran local-parrot.sh with nay heap options and it definitely got further.

[vagrant@localhost yo]$ sh -evx scripts/local-parrot.sh

sh scripts/parrot-server.sh start-local &
sleep 3
+ sleep 3
+ sh scripts/parrot-server.sh start-local

/opt/jdk1.7.0_71/bin/java -server -XX:+UseConcMarkSweepGC -verbosegc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+UseParNewGC -Xloggc:gc-server.log com.twitter.parrot.server.ServerMain -f config/target/parrot-server.scala
sh scripts/parrot-feeder.sh start-local &
[vagrant@localhost yo]$ + sh scripts/parrot-feeder.sh start-local
/opt/jdk1.7.0_71/bin/java -server -XX:+UseConcMarkSweepGC -verbosegc -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+UseParNewGC -Xloggc:gc-feeder.log com.twitter.parrot.feeder.FeederMain -f config/target/parrot-feeder.scala
Jan 09, 2015 1:39:15 PM com.twitter.finagle.Init$ apply
INFO: Finagle version 6.11.1 (rev=83de11a66b498351418433bcad00cbf4b7dc495c) built at 20140122-140449

So I removed the heap options from the resources/scripts/parrot-feeder/server and re-packaged, re-unzipped and tried to run the web example again.

[vagrant@localhost yo]$ java -jar iago-0.6.14.jar -f ../config/web.scala
DEBUG com.twitter.parrot.util 13:47:07.083 logging to console enabled
INFO com.twitter.parrot.launcher 13:47:07.086 Starting Parrot job named web
DEBUG com.twitter.parrot.launcher 13:47:07.088 Creating scripts.
DEBUG com.twitter.parrot.launcher 13:47:07.090 opening resource: /scripts/common.sh
DEBUG com.twitter.parrot.launcher 13:47:07.101 opening resource: /scripts/local-parrot.sh
DEBUG com.twitter.parrot.launcher 13:47:07.102 opening resource: /scripts/parrot-feeder.sh
DEBUG com.twitter.parrot.launcher 13:47:07.108 opening resource: /scripts/parrot-server.sh
DEBUG com.twitter.parrot.launcher 13:47:07.110 Creating configs.
DEBUG com.twitter.parrot.launcher 13:47:07.111 opening resource: /templates/template-server.scala.in
DEBUG com.twitter.parrot.launcher 13:47:09.038 opening resource: /templates/template-feeder.scala.in
sh scripts/local-parrot.sh

And there it stays? There doesn't seem to be any errors.. but I'm not really getting any visibility as to what's actually happening.
Do I just CTRL+C when I think it's done? Seems odd.
Where are the results even stored? web/replay.log is empty, the ones inside the user created folder ("yo" from the readme) just contain debugging information mostly.

[Tom Howland]

The results can be viewed with the admin interface or with Ragianna. This is discussed in the Metrics section of the README