Practical Hadoop For Large Scale Security Information Management

Presented at ToorCon San Diego 13 (2011), Oct. 8, 2011, 4 p.m. (50 minutes)

Hadoop is open-source software for reliable, scalable, distributed computing. This talk covers the distributed processing of large security data sets across clusters of computers using simple programming models. The system is designed to scale from small environments to clusters of thousands of machines each providing local computation and storage. High availability is achieved through software enabling cost-effective scaling and resilience. We show wow to process terabytes of petabytes of security data using the same platform as Yahoo!, Facebook, EBay, LinkedIn,, Ning, Microsoft, Quantcast, Spadac, Twitter, Tegatai and countless other firms.


  • Justin Lundy
    Justin brings over a decade of hands-on Information Security, Engineering and Risk Management experience from major multinational companies such as Sun Microsystems, Viacom, MTV Networks, Paramount Pictures, Citibank, Harmonix Wells Fargo and countless start-ups from the West Coast to the East Coast. Today Justin is CEO of Tegatai, LLC., a provider of Secure Cloud Computing and Secure IP Bandwidth Services for Global Corporations, Enterprises and Governments.

Similar Presentations: