- Hackathon-list - mailman.ripe.net

json tips
by Emile Aben 28 Mar '15

28 Mar '15

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 from the IRC channel, maybe useful for folks: 11:07 < meileaben> maybe a tip for quickly drilling down into json is using 'jq' (http://stedolan.github.io/jq/) 11:07 < meileaben> i find the syntax a bit non-intuitive, but for simple things it works for me 11:08 < RobertKisteleki> a useful plugin for firefox: http://jsonview.co m/ 11:08 < meileaben> example: curl <atlas api call> | jq -c [.prb_id,.af] 11:08 < meileaben> will get you list of probe_ids and protocol_family cheers, Emile -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJVFoNmAAoJEKxthF6wloMOTcAP/jaNUUKYRXdRXshE/QzIUWql 0Ly/Aso58TPExDFS5kAbvzgQpGXzqKKCBdbWyM2Z4k5fl0Ekm4wOF9t8koFm7BrQ dU10dGy0RGD9r1TLmdKrgosCDGGk7wsVw6ZfL++CY98HLG3y8mEWibBIFJe942MB sRyCxps/IDsPxKOqHWcPMv+W51BT68XKUGSxS1nELyOuwzL+TCbJIO1RkvaA8K/0 Z69SIyRl6bGRQFkVbvE3tzhnzdpQnftus/YF9+vbHBPuypq9MJcPhyXUSEkzzQ53 KBr94aYZzZXuV3psCR8jNs7M922qWztFiR/+o7s5Ofmsc6oXWraGbpNrbBL/nz6d RArFE+KkOBYJN7uhNHsyS/Ammxvx6Lt/JVE6GQ8AndYUAgxH2Ch59ZimCdQTAuW1 uRmj8jgCTA8jvIMeVhZ+ZmWZpELp/abnJLbI6DowUCRzw25JYi44Bo2dEnakdg9k VzBlS9QPmrB29bXOEL9WdgU9V7b8Un5z5q3poS5TwaEvRNTCs4u7qIdMR8052dwk 95W/lG3+McrVDqy5cbmGotAiLmoRYI3p3fk9UA9MSlufq1X18w2xg50uK7j+L/be mjKmaYagmYxsMjx3cMxYvSoqQwVK1mN2m4ZvbZmCVx0BmwXf+ZgTFG4kCX+EzOfD 6bvzVAbiC6AQFqg8Wx86 =k8UR -----END PGP SIGNATURE-----

2 1

Detecting when a historic stream has finished and switching to realtime events
by Chris Amin 28 Mar '15

28 Mar '15

Just had this question, so I'll share the answer here because it isn't yet documented properly: If you want to stream historic results at an accelerated speed, and then when you get to the present time switch to the live stream, you have to do the following: 1. subscribe to the stream with startTime (and optionally stopTime) set, and speed set to something more than 1.0 2. wait for the replay to finish, and then re-subscribe to the live stream without time parameters e.g.: socket.on('atlas_replay_finished', function(params) { // params are what you used to subscribe console.log('Stream finished:', params); // Subscribe to the live stream socket.emit('atlas_subscribe', {stream_type: 'probestatus'}); }); // Subscribe to a stream for a historic interval at x12 speed socket.emit('atlas_subscribe', {stream_type: 'probestatus', startTime: 1427551200, stopTime: 1427551300, speed: 12});

1 0

Fwd: RIPE Atlas Hackathon (March 2015) hyperlapse of the morning session - YouTube
by Martin J. Levy 28 Mar '15

28 Mar '15

This morning in a video. Enjoy ... http://youtu.be/BA1SLyRSPHs … no screen seems to be visible in any meaningful manner. Martin

1 0

commandline traceroute tool
by Emile Aben 28 Mar '15

28 Mar '15

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I put the code that I run locally on my laptop to do one-off traceroutes on Github: https://github.com/emileaben/cmdline-atlas-trace I'll spend a little more TLC on making sure dependencies etc. are documented and this might actually work on other peoples machines. Usage: etrace [-h] [-a ASNV4] [-s ASNV6] [-p PROBE_ID] [-c COUNTRY] <destination> If people want to build on this (for instance use the streaming-API instead of just polling the RIPE Atlas measurement API until a result comes in), please feel free to do so. cheers, Emile -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJVFoOgAAoJEKxthF6wloMOXZ0P/0RAjom+uV79vE0PSSOLI4AI WMIFIschwgBeUnMKUBDA3qk1qhQWPQsb4lQnDYSu2h2+fD+mscgh/ML4AYAZj2DX RBH1UAR6/L44vqOFNOmlelYMSeCKFHGdO/+X+zZqSQ+LXHSiNvU7mwOgBxto5z/V zs0Ae8sP6VYxncyy5kxOJfpXLzPNwsLtQOTjvFJw13SSpqqsqLcEl7f7dYL0cCyK nKCX4GGlXZMhPlYACg23IcIsLx6T3FZSJIPQKKrWRSCia5UFeBkYRTbKKYpqyHaM dLk3fiWEUDZO4gq3Jx1BjFFMe01ZarXo+8jeIVo8MCQ/9ErXWYfDJemJM4CB6ZfL TuJG8KxkjesAkisN1vnvrkjjKhJ8uwrUxdXU0pBHRQfSMj4w2KMyzv0HzwzrMSL6 7rkJnY2K/ur4pxiDPdgsQpJ5CHegZFZh9qTi/aCxHlXRm3OvuRIgNCFj/CG8HlLL dX01IqB/8zsmkz/sUNhphIToxjtD1ED5OqtK2/iwCBHjH/znsKhWJL8o/Utv6B3X YqjdDqu3rbZjpene4u5ZJtOaj2PGycFW0wcndKhDoGRgr8EA2ie9lIjexkikwsQZ FLexfVs5ZWSuypxGOXqIXreXjhF2lgmZuQ6oDhKkG3nh2UtfrIEtbPtD4HVTNQe1 qf6Bcq/44GU+Y0vTGFcZ =sb5q -----END PGP SIGNATURE-----

1 0

Probe and measurement snapshot for offline access
by Iñigo Ortiz de Urbina Cazenave 28 Mar '15

28 Mar '15

Hola! The USB stick we've distributed does not include the following two datasets: https://atlas.ripe.net/dstatic/measurements/dumps/meta-20150223.txt.bz2 https://atlas.ripe.net/dstatic/probes/dumps/meta-20150223.txt.bz2 These two contain the probe and measurement archives in JSON format. This should spare you (and us :-) the pain of walking the API to get the info of all probes and measurements. You are encouraged to download them for offline access. Cheers, Iñigo

2 1

Software art
by Larisa Blazic 28 Mar '15

28 Mar '15

Check out http://runme.org

1 0

PGP Key signing while we are here ...
by Martin J. Levy 27 Mar '15

27 Mar '15

Does anyone need a quick key signing huddle while we are here? http://xkcd.com/364/

1 0

Experimental RIS BGP streaming
by Chris Amin 27 Mar '15

27 Mar '15

The experimental RIS BGP streaming API is available for the purposes of this hackathon, with the following caveats: * This as an experiment: we want to know if it's feasible and if there is demand for it. There's no guarantee that it will continue to exist! * The interface (parameters and outputs) will undoubtedly change over time. * This is a prototype and not currently operationally stable. I'll keep it going on a best effort basis throughout the weekend. Poke me (gently) if it dies. That said, you can hook up to a simple stream using Javascript like this: http://stream-dev.ris.ripe.net/simpletest.html.txt Examples of output messages: withdrawl: {"peer":"217.29.76.6","timestamp":1427473498.63,"prefix":"12.30.110.0/24","rrc":"rrc-test.ripe.net","type":"W"} announcement: {"timestamp":1427473556.32,"rrc":"rrc-test.ripe.net","prefix":"111.91.229.0/24","next_hop":"77.72.229.74","peer":"77.72.229.74","path":[12654,9002,9498,38571],"type":"A"} Note: it is possible to filter the stream with various subscription parameters. If you want to do this, please let me know your use case and I'll hook you up. Cheers, Chris

1 0

commandline traceroute tool
by Emile Aben 27 Mar '15

27 Mar '15

-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi, I put the code that I run locally on my laptop to do one-off traceroutes on Github: https://github.com/emileaben/cmdline-atlas-trace I'll spend a little more TLC on making sure dependencies etc. are documented and this might actually work on other peoples machines. Usage: etrace [-h] [-a ASNV4] [-s ASNV6] [-p PROBE_ID] [-c COUNTRY] <destination> If people want to build on this (for instance use the streaming-API instead of just polling the RIPE Atlas measurement API until a result comes in), please feel free to do so. cheers, Emile -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQIcBAEBAgAGBQJVFYY3AAoJEKxthF6wloMOYRQP/3YK6opOYL90Kbu0FwL8Bfk9 a/vHfpnouykxnrIj1gzi9USaBijl9QP2lCvnudKuG9t6D7xn93uYQKI7Dubm8cEW st5Y4jyLpOldK1svwuW4gHyoLrp8zX5kOXGCY70zqfa2DAEJKhf2TT6OSFuHxlj9 4wWRMm0tYN5P84FnzRaPGLEj87CoAZQB0a7LT+r9TUX9+celmJk90jBbRwqrMrap v63LZvJocR7RFFKnNTQP2WPeCYPBFSK8pAhgNXMpD8oRUm44Mhio3T3Fm2bG431R SM7YQH8ljZLyQlqeOIMYyrxNy/0FWjVfajx5UTc2+CQbl1RplU+iUhgKyprNy7ep GH0wJGoQWukBvuhbaGCe2Os1WTIcR0ifH1ERpxz98bsE8aK/UrhET0gGLSnXPDtv XEw8ruuZRAk9WLL51gIw8dSt6I6b/Xq44pQAbrZYzHlvFCC4ZIOOfDlmxGlvp1/b QwAUXxyFWThZOUsog7v3kMHaNorf++VneJdqhanQc8XYn0BBUzYOcrwleZxvAQwI LzmjjTemcZofOlh3mgVnD3kAqG+lzycLhXn2+78gh4uDjMYguUg93f3U3A0tjUMu dx08V2zZnft+DMrNvl4kdglhXW6D4tO+Jgdy1wAlk6UwcHdX3kXj+cCxBLU8C1iF ryPV7KTrK93QY2WQSI/l =FUpZ -----END PGP SIGNATURE-----

1 0

Getting the (very) recent history for a measurement from the streaming API
by Chris Amin 27 Mar '15

27 Mar '15

Hi! You now have or will soon have the preview version of the streaming API documentation on your USB stick. As I mentioned, I actually forgot to document the parameter for giving you enough data to cover the gap between the latest stuff in the REST API and the version of "now" in the live stream. You do it like this: socket.emit('atlas_subscribe', { msm: MSM_ID, sendBacklog: true }) This will give you an "amount" of data (currently 4 minutes, but we reserve the right to change this!), which is intended to cover that gap in the vast majority of cases. You will have to deal with duplicate results if you're trying to join on to the end of a REST API dataset. Sorry for the omission. Of course you can come and talk to me if you have any other queries. Cheers, Chris

1 0