gitDigger: Creating useful wordlists from public GitHub repositories

Presented at DEF CON 21 (2013), Aug. 4, 2013, 10 a.m. (20 minutes)

This presentation intends to cover the thought process and logistics behind building a better wordlist using github public repositories as its source. With an estimated 2,000,000 github projects to date, how would one store that amount of data? Would you even want or need to? After downloading approximately 500,000 repositories, storing 6TB on multiple usb drives; this will be a story of one computer, bandwidth, basic python and how a small idea quickly got out of hand.

Presenters:

• Rob Fuller / mubix   as Rob Fuller (Mubix)
  Rob Fuller (Mubix) is a Senior Red Teamer. His professional experience start from his time on active duty as United States Marine. He has worked with devices and software that run gambit in the security realm. He has a few certifications that haven't expired yet, but the titles that he holds above the rest is father, husband, and United States Marine.
• Jaime Filson / WiK   as Jaime Filson (WiK)
  Jaime Filson (WiK) ell, WiK's just zis guy. He enjoys long walks on the beach while his computer equipment is busy fuzzing software, cracking passwords, or spidering the internet.

Links:

• https://defcon.org/html/defcon-21/dc-21-speakers.html#Filson
• https://infocon.org/cons/DEF CON/DEF CON 21/DEF CON 21 video and slides/DEF CON 21 - Jaime Filson and Rob Fuller - gitDigger Creating useful wordlists - Video and Slides.mp4 (Video and Slides)
• https://www.youtube.com/watch?v=BCu66Hk9zgA

Similar Presentations:

• BSidesLV 2023 / The attackers guide to exploiting secrets in the universe
• DerbyCon 3.0 All in the Family (2013) / gitDigger: Creating useful wordlists from public GitHub repositories
• DEF CON 19 (2011) / Pillaging DVCS Repos For Fun And Profit