Chris Donnan : Programming – Brooklyn Style

03/02/2013

Cool – instant Python Web Server – no dependencies

Cool.

Instant Python web server.

Filed under: programming — chrisdrop @ 19:02

26/12/2012

Hive, Hadoop and the rest of that world….

I recommend watching this over at Info Q for a solid overview of the space: http://www.infoq.com/presentations/Introducing-Apache-Hadoop . I like the frame here; this is a data ‘operating system’. There needs to be a macro level data rationalisation of data in the world and Hadoop is the right ‘base layer’ IMO (based on todays technology offerings out there). Even though this technology is somewhat ‘old’ at this point it is much newer than say old style relational classical SQL DB and it is now at a reasonable point of maturity for general adoption.

Google’s Spanner is worth reading about for what is now ‘newer’ tech, but not ready for mainstream consumption unless you want to build your own.

  1. Setup some Hadoop for yourself – Ubuntu “quick” guide here: http://www.michael-noll.com/tutorials/running-hadoop-on-ubuntu-linux-single-node-cluster/
  2. Setup Hive here: https://cwiki.apache.org/confluence/display/Hive/GettingStarted#GettingStarted-InstallationandConfiguration

I think the whole ecosystem here consisting of Hadoop, Hive here is great. Add to the list of useful related technologies that are just available now to get and use:

  • Flume (get data in!)
  • sqoop interop/ cope with traditional relational DBs
  • Pig more ETL like tool, not sure if it is redundant with Hive/ other techs yet…
  • OpenTSDB time series database – useful for capturing data that is … well – a time series (think app metric streams)

This is all makes the case for a large scale data management environment – using open source tools – that can handle massive amounts of data in many different forms.

 

Filed under: big data,nosql — chrisdrop @ 19:15

16/09/2012

Weekend reads (market impact models, Markov models, probability and statistics)

 

Filed under: AI/ Machine Learning,algorithmic trading,trading — chrisdrop @ 17:50

05/06/2012

A few interesting references in the new Facebook Folly open source C++ project

Folly can be found here

https://github.com/facebook/folly/

A few good doc refs…

Skip lists from the Concurrent Skip List ref here

Some lockless assembly fun from the Read-write spin lock here

Filed under: C++ — chrisdrop @ 09:06

24/05/2012

Cool presentation on ZeroMQ (one of my fav tools)

Also includes some python examples, which I also like.

Watch it – or just get the slides

Filed under: python,zeromq — chrisdrop @ 20:12

19/11/2011

GCC 4.6.1 on Mac Lion

Good instructions here, but too much klunking around….

On Lion, will need to download:

../configure --prefix=$HOME/my_gcc ABI=64
../configure --prefix=$HOME/my_gcc --with-gmp=$HOME/my_gcc ABI=64
../configure --prefix=$HOME/my_gcc --with-gmp=$HOME/my_gcc --with-mpfr=$HOME/my_gcc ABI=64
../configure --prefix=$HOME/my_gcc --enable-checking=release --with-gmp=$HOME/my_gcc --with-mpfr=$HOME/my_gcc --with-mpc=$HOME/my_gcc --program-prefix=my- ABI=64
Filed under: C++,mac — chrisdrop @ 15:04

FastFlow

FastFlow (???) is a parallel programming framework for multi-core platforms based upon non-blocking lock-free/fence-free synchronization mechanisms.

Ooh, aah. This is lovely. Look out disruptor, there is nothing new under the sun apparently.

Very, very nice.A work colleague pointed FastFlow out to me yesterday and I have spent the morning reading/ playing. Big fan so far.

Filed under: C++ — chrisdrop @ 10:35

24/09/2011

C++ Open Source Market Data Feed-handlers

C++ Open Source Market Data Feed-handlers

Feed-handlers for:

  • arca
  • bats
  • directedge
  • itch
  • opra

Code looks pretty well written.

Code on github – here

Filed under: C++,market data — chrisdrop @ 16:50

12/08/2011

How Algorithms Shape Our World

Fantastic Ted Talk about how algorithms are changing our world.

How Algorithms Shape Our World

Filed under: algorithmic trading — chrisdrop @ 19:00

25/07/2011

C++ Optimization Manuals

C++ Optimization Manuals

Filed under: C++,coding,low latency — chrisdrop @ 15:40

23/07/2011

OpenOnload

Not new, but someone was asking me about this the other day… here you go – OpenOnload docs from SolarFlare

Filed under: C++,coding,low latency — chrisdrop @ 22:18

14/07/2011

Quick C++ Re-post…

Suicide by C++ And How to Avoid It

Filed under: C++,coding,programming — chrisdrop @ 20:42
Next Page »

Powered by WordPress