I gave a general technical talk on building a distributed web crawler at last Friday’s NUS Hackers meetup. Here are my presentation slides, which I used during the talk. We are hiring! If you are interested in joining a … Continued
Author Archives: varun
Authenticating with the Semantics3 Products API using Objective-C
This post was written by our guest author, Youssef Mehamed, who is a Mobile Developer and Sys Admin. He is currently studying Computer Science in Melilla, Spain. StackOverflow. App Store Profile. LinkedIn. The Semantics3 Products API uses the Oauth v1.0 … Continued
How We Built Our 60-Node (Almost) Distributed Web Crawler
Web crawling is one of those tasks that is so easy in theory (well you visit some pages, figure out the outgoing links, figure out which haven’t been visited, queue them up, pop the queue, visit the page, repeat), but … Continued
Building A Paid API Offering
In this post I am going to talk about how we built the backend infrastructure to support our Products API, Semantics3’s core product. This post can also be seen as a follow up or maybe even a reply to a … Continued
Talk@BigData.sg: Systems Architecture at Semantics3
I spoke about our back-end infrastructure at the May meetup of BigData.sg. Here are my presentation slides, which I used during the talk. In the coming weeks I plan to write a few blog posts regarding specific aspects … Continued
Introducing Srinivas Kidambi
I am very excited to introduce our first engineering hire and fourth hacker to join our team, Srinivas Kidambi aka Kid! Kid is a recent graduate from the National University of Singapore. He is a computational geometry expert, having done … Continued
The Unexpected Benefits Of Weekend Projects
The past few weekends I have been working on a personal side project (20% time project à la El-Goog) called Quanthunt with a friend of mine, Eileen Chan. It is basically an online trading platform where you compete with others … Continued
Tags: amqp, beanstalk, distributed, gearman, infrastructure, messaging queues, rabbitmq
Talk@NUS Hackers: Adding GNU Screen to your Workflow
I gave a technical talk titled ‘Adding GNU Screen to your Workflow‘ last Friday at the NUS Hackers student club’s Friday Hacks event. Here are my presentation slides, which I used during the talk.
A Humble Tribute to Richard Stallman
(C) Richard Stallman – stallman.org One of my biggest regrets when I was based in California during my junior year of college, was missing out on Richard Stallman’s talk at Stanford University. Today, that regret was laid to rest. I … Continued
When Hacker News Brought a Visitor from the UK to our Doorstep in Singapore
Everyone knows that your site gets bombarded with (virtual) visitors when any of your pages trends on Hacker News. We’ve been fortunate to have that happen twice recently thanks to posts about our experience with conferences and our mad weekend codesprint. … Continued