API Request Logging

88 views
Skip to first unread message

igtsvi

unread,
May 9, 2015, 3:19:18 AM5/9/15
to api-...@googlegroups.com
I manage API for a SaaS company. Our customers build applications which talk to us through our APIs. I need a way to log and analyze the API traffic. I don't necessarily want to build any of these analytics tools myself. What options for of-the-shelf solutions do I have?

Thanks,
igtsvi

darrel...@gmail.com

unread,
May 9, 2015, 10:12:32 AM5/9/15
to api-...@googlegroups.com
Hey Igtsvi,

You might want to look at Runscope (www.Runscope.com).   We have tooling that allows to log, monitor, measure and share API traffic.  There is a no-credit card sign-up so it is easy to try.  If you have any questions you can email me or he...@Runscope.com

Disclaimer: I work as a dev advocate for Runscope.

Darrel 
--
You received this message because you are subscribed to the Google Groups "API Craft" group.
To unsubscribe from this group and stop receiving emails from it, send an email to api-craft+...@googlegroups.com.
Visit this group at http://groups.google.com/group/api-craft.
For more options, visit https://groups.google.com/d/optout.

Chris Mullins

unread,
May 10, 2015, 3:19:02 AM5/10/15
to api-...@googlegroups.com
I've got the obvious questions:

1. What questions are you trying to answer?
2. What options have you looked at? 
3. What do your logs look like? 


My experience with log analysis is that everyone wants something different. Some want basic metrics and dashboarding, others are looking for security and information disclosures, and others are doing... well, everyone wants something different. 

My personal experience is that metrics give 90%+ of what I generally want: Call Rates, Latencies, Faults, Errors, Throttling and Tarpitting, etc. The only time I find the need to dive into logs is to pull error traces from machines. 

Cheers,
Chris

jeff fitzgerald

unread,
May 11, 2015, 8:50:09 AM5/11/15
to api-...@googlegroups.com
Take a look at splunk (http://www.splunk.com/).

- fitz

igtsvi

unread,
May 15, 2015, 12:49:45 PM5/15/15
to api-...@googlegroups.com
Currently we have a very rudimentary log analysis on total number of API calls per each customer per 24 hours. This is not sufficient. We'd like to be able to tell:

Per each customer:
1. What endpoints are being called
2. At what rate
3. Who is the user

Further, we need to be able to aggregate and analyze totals and trends over time.

I haven't looked at any tools yet, as I don't know where to start.

Thanks.
Reply all
Reply to author
Forward
0 new messages