Menu

Continuous Deployment with Spark Streaming (Part II)

April 16, 2018

In Part 1 of this series, we gave a brief look into the data platform at Wealthfront, focusing on how we minimize data processing downtime while redeploying our Spark Streaming jobs. In this final part of this series, we will describe how we coordinate the data in our serving layer and wrap the blog post… Read more

Continuous Deployment with Spark Streaming (Part I)

April 06, 2018

Here at Wealthfront, our mission is to democratize access to sophisticated financial advice. One of the ways we accomplish that is by applying data processing technologies to financial services. In this two-part blog post we will describe how our near-real time data platform is built to support continuous deployment in order to allow us to… Read more

Configuration… Hardcode it!

November 21, 2013

If you’ve read other Wealthfront engineering blog posts (Continuous Deployment: API Compatibility Verification, Move cash faster, Pushing a Feature On My First Day), you’re aware that continous integration and deployment forms the core of our development process. Many consequences of a continuous integration and deployment process such as ours are obvious – high confidence test… Read more

Pushing a Feature On My First Day

October 04, 2013

  One of my main reasons for joining Wealthfront was its engineering culture. After meeting the team as well as perusing the engineering blogs, I was excited to start working here. So how did the first day fare? Well I was setup with all of the major projects, finished work on a small feature for… Read more

Continuous Deployment: API Compatibility Verification

March 19, 2013

We haven’t said much about our continuous deployment system recently. Mostly that’s because there hasn’t been much to say. We invest in systems and infrastructure through a process called proportional investment: we spend time on areas that cause us problems and our deployment infrastructure has performed well, requiring little incremental investment. However, recently we made… Read more

Hurricane Sandy puts YAGNI to the test

November 13, 2012

On Sunday night, Oct 29th, we learned that most US equities markets would be closed the next day due to Hurricane Sandy. This is very unusual: the only times the market has been closed since the four days following 9/11 have been the National Days of Mourning following the deaths of Presidents Reagan and Ford,… Read more