The Curious Engineer

All blogs / Go

Ben E. C. Boyter

boyter.org

Recent content on Ben E. C. Boyter

GoSoftware / engineering practicePerformance / optimizationAI / ML

’10’15’20’25
Posts
287 from 26 Feb 2008 to 10 Sep 2026
Posting
monthly (10 in the last year)
Kind
personal blog
Feed
https://boyter.org/index.xml

2026 9

  1. Would You Kindly... Search Without an Index?
  2. Sloc Cloc and Code - Did I just get Buster Scrugged?
  3. Sloc Cloc and Code 4.0 (scc) - Finding the files that need the most attention
  4. Fortified Wines - The underappreciated drink
  5. Sloc Cloc and Code - LOCOMO (LLM Output COst MOdel)
  6. Marketing to the Machine - The first website with LLM testimonials - searchcode.com
  7. Publishing a second game using pico-8
  8. Code Spelunker a Code Search Command Line Tool Redux
  9. Boilerplate Tax - Ranking popular programming languages by density

2025 10

  1. Replacing my old desktop with a high-end Linux PC
  2. searchcode.com is being rebooted (maybe?)
  3. Running and storing 3+ million LLM AI requests without spending $100,000
  4. A lesson on Trust but Verify and Managing Upward
  5. Old Desktop to Linux - Wayland is still not ready
  6. Visualizing a search in searchcode.com through the blinkenlights
  7. Sydney Go meetup March 2025
  8. Vibe coding searchcode a new UI and saving myself 40+ hours of work
  9. searchcode.com’s SQLite database is probably 6 terabytes bigger than yours
  10. Simple Go Cache

2024 10

  1. Disable Slog Messages in Go Tests
  2. Bloom Filters and SQLite
  3. scc vs stto a code counter head to head
  4. ServerlessDays ANZ 2024 - All slides, notes and links
  5. Sloc Cloc and Code - ULOC Unique Lines of Code
  6. One hundred million little queries
  7. Resolve "database is locked" with Go and SQLite
  8. Brute force text search optimizations
  9. Installing direnv on macOS
  10. Supporting scc and my other free software tools

2023 13

  1. Go Libraries/Packages I Like
  2. We don't need no stinking bastion host!
  3. GopherConSyd 2023 - All slides, notes and links
  4. Publishing my first game using pico-8
  5. DataEngBytes 2023
  6. Walk code repositories respecting .gitignore files in Go
  7. Code Spelunker how it works
  8. Code Spelunker a Code Search Command Line Tool
  9. How to start a Go project in 2023
  10. Real World CPU profiling of ngram/trigram tokenization in Go to reduce index time in searchcode.com
  11. Deduplicate a slice in Go, use sort or a map?
  12. How to implement Go Channels in Java
  13. ActivityPub -> Announce -> Post

2022 14

  1. Explore the fediverse, but use block like it's a machine gun in a zombie apocalypse
  2. Building a custom code search index in Go for searchcode.com
  3. Elite speak GUID script
  4. Go install loop. The "clang" command requires the command line developer tools.
  5. Decompiling Java, Excel and the Vista TCP/IP stack
  6. Some of the more annoying Go bugs I have dealt with
  7. Cost of a integer cast in Go
  8. If you succeed, you will fail
  9. AWS Abusing Search Engine Gets Abused
  10. Search index implementations
  11. Testing and Running Go API GW Lambda's Locally
  12. The Most Incompetent Person I Ever Worked With
  13. Installing voice2json on Ubuntu
  14. Resurrecting Bogan Ipsum

2021 8

  1. Development Practices
  2. Moving a MySQL/MariaDB database between servers using SSH
  3. Abusing AWS Lambda to make an Aussie Search Engine
  4. The National Broadband Network - A Real Ending
  5. Upgrading my old desktop
  6. Interesting Go Memory Issue
  7. Useful bootstrap checklist for Go Projects
  8. Intern interview questions

2020 8

  1. Bloom Filters - Much, much more than a space efficient hashmap!
  2. My First PC
  3. Faster Literal String Matching in Go
  4. Stay Safe on the Road
  5. The National Broadband Network (NBN) A Massive Dissapointment
  6. Unicode support. What does that actually mean? 😃
  7. Building a API rate limiter in Go for searchcode
  8. searchcode Rebuilt with Go

2019 19

  1. The Three F's of Open Source Development
  2. Sloc Cloc and Code - Can a crusty Go program outperform a well written Rust Project?
  3. Elasticsearch mappings - How to add Facets and Aggregations
  4. How Elasticsearch Stores Documents
  5. My list of useful command line tools
  6. Processing 40 TB of code from ~10 million projects with a dedicated server and Go for $100
  7. How AWS and Go Transformed a Public Broadcaster
  8. Sloc Cloc and Code Badges for Github/Bitbucket/Gitlab
  9. A really cheap chatbot in Python
  10. How good does the Monaro look
  11. A non-gamers attempt at Sea of Thieves
  12. Processing Large Files – Java, Go and 'hitting the wall'
  13. Developer Empowerment - Move fast, don't break things (for long), be productive
  14. Media Clipping using ffmpeg and Cache Eviction 2 Random for Disk Caching at Scale
  15. My Personal Complaints about Programming in Go
  16. Learn Enough tmux to be Productive in 5 Minutes
  17. Use Go to Restore Glacier to S3
  18. Sloc Cloc and Code a Performance Update
  19. Trimming the fat from a Golang binary

2018 14

  1. Expert Excuses for Not Writing Unit Tests
  2. Types of Development
  3. Generating Harry Potter Spell Names and Kelewan House Names
  4. Sloc Cloc and Code Revisited - Optimizing an already fast Go application
  5. Sloc Cloc and Code Revisited - A focus on accuracy
  6. Reading files quickly in Rust
  7. Why count lines of code?
  8. How to add multiple tags to a Go struct
  9. How to start a Go project in 2018
  10. Python SimpleHTTPServer to serve a directory
  11. Sloc Cloc and Code - What happened on the way to faster Cloc
  12. A quick comparison between different Go file walk implementations
  13. Collection of my favorite optimization posts and articles
  14. Licensechecker. A command line application which identifies what software license things are under

2017 10

  1. Simply encrypt or decrypt a string using Boto3 Python and AWS KMS
  2. searchcode plexus
  3. BBQ with a Dutch ICT/start up Delegation
  4. Working with Rust
  5. Design for searchcode server
  6. Home Battery Systems – You may de-rate system capacity
  7. How to identify software licenses using Python, Vector Space Search and Ngram Keywords
  8. Why is this GoLang solution faster than the equivalent Java Solution?
  9. Setup up ConcourseCI 2.6.0 behind Nginx with Self Signed Certificates on Ubuntu 16.04
  10. Repository overview now in searchcode server

2016 18

  1. Sphinx Real Time Index How to Distribute and Hidden Gotcha
  2. Explaining VarnishHist – What Does it Tell Us
  3. MySQL Dump Without Impacting Queries
  4. To all Companies Currently Recruiting
  5. GPL Time-bomb an interesting approach to #FOSS licensing
  6. searchcode server under fair source
  7. The Worst Individual I Ever Worked With
  8. Types of Testing in Software Engineering
  9. Syncing Stash/BitBucket with searchcode server
  10. Python Fabric: Getting File from Host as String
  11. searchcode.com: The Architecture – migration 3.0
  12. How to Hide Methods From Fabric Task Listing
  13. Python Fabric How to Show or List All Available Tasks
  14. Set Ubuntu Linux Swapfile Using Python Fabric
  15. Python Fabric Set Host List at Runtime
  16. What is Chaos Testing / Engineering
  17. A Collection of O'rly book Covers
  18. searchcode server released

2015 33

  1. searchcode server
  2. Pi-Hole for Ubuntu 14.04
  3. searchcode local
  4. Go Forth and Search
  5. Exporting Documents from KnowledgeTree 3.7.0.2
  6. Decoding CAPTCHA's Handbook
  7. Running three hours of Ruby tests in under three minutes
  8. A Culture of Quality
  9. C# as a Language from old Google+ Post
  10. A/B Testing
  11. Five ways to avoid and control flaky tests
  12. Why Does Software Contain Bugs?
  13. searchcode the path to profitability
  14. The benefit of testing for Developers, Managers and the Business
  15. AWS EC2 Instance Types to Use as Test Agents
  16. Issues with Google's Bug Prediction Algorithm
  17. What is Usability Testing?
  18. Mutation Testing or How to Test Tests
  19. Who is Responsible for Software Quality?
  20. A story about Hubris and Integration Tests
  21. How searchcode.com is Unit and Integration Tested
  22. Flaky Tests
  23. Clean Testable Repository Data Access in C Sharp
  24. The Unsung Benefits of Software Testing
  25. Testing In Software Engineering
  26. Grouping Tests: Unit/Integration vs Fast/Slow Tests
  27. Sanity Testing
  28. Filetree Listing
  29. Updates to searchcode.com
  30. Decoding Captcha's Presentation
  31. C# XML Cleaner Regex
  32. Regular Expressions are Fast, Until they Aren't
  33. Rebound Project

2014 29

  1. Portfold: Topic Research Software
  2. Why searchcode.com isn't 100% free software
  3. Interesting Code Comment
  4. Feedback Loop
  5. What is special about DDG
  6. YourStory Interview
  7. Sphinx and searchcode
  8. Estimating Sphinx Search RAM Requirements
  9. searchcode next
  10. Chatbot Nonsense
  11. Not so unique GUID
  12. Implementing C# Linq Distinct on Custom Object List
  13. Installing Phindex
  14. More interview snippets….
  15. Another day another interview…
  16. searchcode screenshot
  17. Sample Coding Test
  18. Bitcoin Clones use Same Network?
  19. Python pep8 git commit check
  20. Regarding the Zombie Apocalypse
  21. New searchcode Logo
  22. The worst program I ever worked on
  23. Why you should never ask permission to clean up code
  24. Why is storing, tracking and managing billions of tiny files directly on a file system a nightmare?
  25. Counter-counter argument TDD
  26. China Trip 3
  27. China Trip 2
  28. China Trip
  29. Can anyone explain how this regex [ -~] matches ASCII characters?

2013 19

  1. Quora answer about writing a search engine
  2. Introducing SingleBugs the Bug Tracker for Single Developers
  3. The Fizzbuzz Bug Tracker A Bug Tracker for Single Developers
  4. Collection of Letters for Neural Network OCR Training
  5. Saving Resources for Humans in PHP
  6. C# Vector Space Implementation
  7. GoLang Vector Space Implementation
  8. Clean Repository Data Access in C#
  9. Gigablast Aquired and Code Posted
  10. List of useful CAPTCHA Decoding Articles
  11. Decoding CAPTCHA’s
  12. Building a Search Result Extract Generator in PHP
  13. Why Code Search is Difficult
  14. Want to write a search engine? Have some links
  15. Code a Search Engine in PHP Part 5
  16. Code a Search Engine in PHP Part 4
  17. Code a Search Engine in PHP Part 3
  18. Code a Search Engine in PHP Part 2
  19. Code a Search Engine in PHP Part 1

2012 15

  1. Variety of Updates
  2. Building a search engine? The most important feature you can add.
  3. Updates in the Works
  4. Billions of lines of code
  5. Codesearch API
  6. Running the Numbers
  7. Who Knows Regex
  8. Expanded Syntax lang Keyword Now Supported
  9. Growing Index
  10. Performance
  11. Improving the Index
  12. Growing Pains
  13. Updates Coming Soon
  14. Mutation Tester for All Languages
  15. Errors in Search

2011 26

  1. searchcode now supports regex code search
  2. Wildcards
  3. Hello World Collection
  4. Underscore.js joins the party
  5. Google Killing off Code Search
  6. Coverage
  7. Slow
  8. Hard Numbers
  9. Vector Space Search Model Explained
  10. Grep Match a Tab
  11. Clojure 1.3 Now Avaliable
  12. Link Love
  13. Nginx HttpCoreModule Documentation
  14. jQuery Hello World Plugin
  15. jQuery Documention Now Avaliable
  16. How I store Enumerations in the Database
  17. Lesson Learnt – Save Assets
  18. iOS Documention Now Available
  19. Lorem Ipsum Word Generation
  20. List of Most Commonly Used PHP Functions
  21. List of MySQL, SQL Server 2008 and Apache Directives
  22. List of all GNU/Linux and Windows Commands
  23. BATF – Big Arse Text File
  24. Using wget and xargs
  25. MySQL Export to CSV
  26. MySQL Command Line Import UTF-8

2010 26

  1. MySQL Popularity Ranking Algorithm
  2. The Web is Bigger Then You Think
  3. Minimum Viable Product MVP
  4. MySQL Error – Error:1356: View references invalid.
  5. Startupcamp Opinions
  6. Python Snippet
  7. How Cuil got $33 million in funding?
  8. PHP Entity Generator
  9. Google's “Colossus”
  10. First Failure at Selling an Application Online
  11. Small Steps 2 – Teaching a Neural Network to Learn the Letter A from B-Z
  12. Small Steps 1 – Teaching a Neural Network to Learn the Letter A from B
  13. Always Go To First Principles
  14. Building a Vector Space Indexing Engine in Python
  15. Why CAPTCHA's Never Use Number's 0 1 5 7
  16. Setting up GIT to use a Subversion (SVN) style workflow
  17. Why You Shouldn't roll your own CAPTCHA
  18. MySQL Backups Done Easily
  19. Richard Stallman to visit Australia
  20. At Scale You Will Hit Every Performance Issue
  21. Examples of Bad Website Search
  22. Test Driven Development
  23. Why Writing a Web Crawler isn't Easy
  24. MySQL Exporting All Databases
  25. PHP Bug Trackers
  26. Launched. Somewhat.

2009 4

  1. Impressed
  2. Interface Vs Inheritance
  3. On LINQ
  4. How will a Athlon 64 PC with 512 of ram hold up as a home server?

2008 2

  1. Data Mining
  2. SQL For Fun!?