Weekly Subscriptions

Revisiting BetterTLS: Certificate Path Building

By Ian HakenLast year the AddTrust root certificate expired and lots of clients had a bad time. Some Roku devices weren’t working right, Heroku had problems, and some folks couldn’t even curl. In the aftermath Ryan Sleevi wrote a really great blog post not just about the issue of this one certificate’s expiry, but the problem that so many TLS implementations have in g...

Efficient Resource Management at Pinterest’s Batch Processing Platform

Yongjun Zhang | Software Engineer; Ang Zhang | Engineering Manager; Shaowen Wang | Software Engineer, Batch Processing Platform TeamPinterest’s Batch Processing Platform, Monarch, runs most of the batch processing workflows of the company. At the scale shown in Table 1, it is important to manage the platform resources to provide quality of service (QoS) while achievin...

CAMBI, a banding artifact detector

by Joel Sole, Mariana Afonso, Lukas Krasula, Zhi Li, and Pulkit TandonIntroducing the banding artifacts detector developed by Netflix aiming at further improving the delivered video qualityBanding artifacts can be pretty annoying. But, first of all, you may wonder, what is a banding artifact?Banding artifact?You are at home enjoying a show on your brand-new TV. Great ...

Improving HDFS I/O Utilization for Efficiency

Scaling our data infrastructure with lower hardware costs while maintaining high performance and service reliability has been no easy feat. To accommodate the exponential growth in both Data Storage and Analytics Compute at Uber, the Data Infrastructure team massively overhauled ... The post Improving HDFS I/O Utilization for Efficiency appeared first on Uber Engineer...

GraphQL 101: What is GraphQL?

Most people within the tech world have heard of GraphQL at this point. Adoption is also booming at steady rates....

Migrating Kafka transparently between Zookeeper clusters

Learn more about how to migrate your Kafka cluster from one Zookeeper cluster to another without any user impact.By: Edmund MokIntroductionKafka is an open-source distributed event-streaming platform. It depends on Zookeeper, another open-source distributed coordination system, to store cluster metadata. At Airbnb, Kafka forms the backbone of our data infrastructure, ...

Hack Week 2021 Round-Up!

For the second year in a row, we had a (mostly) remote Hack Week. Our Google Meet-hosted demos were a great time. There is actually something very fun about the immediate stream of comments in the sidebar which celebrate the ingenuity of the various hacks and their creators. BuzzFeed Tech, as per usual, took a week off from the normal meetings and roadmaps — and hacke...

Write Once, Test Everywhere — Simplified SDK Testing

Write Once, Test Everywhere — Simplified SDK TestingHow PayPal used the Platform Agnostic Automation Framework to simplify SDK testingPhoto by NASA on UnsplashThe latest and most advanced approaches to the product development lifecycle are constantly trying to achieve the best balance between speed and efficiency. With customer-centric product approaches taking center...

An Innovative Way to Predict Continuous Variables: From Regression to Classification

Photo by Tobias Fischer on UnsplashIntroduction: When it comes to the prediction of continuous variables, the first thing that comes to our mind is always the regression model. For instance, linear regression is the most commonly used regression model, and it has the benefits of simple implementation and high interpretability. On the other hand, random forest regressi...