Staff Data Infrastructure Engineer

The posting, as Faire wrote it

About Faire

Faire is a technology wholesale platform built on the belief that the future is local. Independent retailers around the globe collectively represent a multi-hundred-billion-dollar wholesale market that has historically been fragmented and offline. At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of entrepreneurs across the globe. Picture your favorite boutique in town — we help them discover the best products from around the world to sell in their stores. With the right tools and insights, we believe that we can level the playing field so businesses can grow and local communities can thrive.

We’re looking for smart, resourceful and passionate people to join us as we power the shop local movement. If you believe in community, come join ours.

About this role

Our Engineering organization owns the software that makes our marketplace work. The Data Platform group supports everyone at Faire who depends on data: Product Engineering, Data Science, Machine Learning, Analytics, Strategy, Finance, and Product. Our job is to make sure the data is there, it's right, and people can find it and query it without having to think about the plumbing underneath.

We are hiring a Staff Engineer to own that plumbing. Concretely, this means the path data takes out of our production databases (CockroachDB and MySQL) and into a place where analysts and data scientists can query it. Today that involves Fivetran, Kafka, Spark, and Airflow landing data in Snowflake and Databricks. It works, but it grew up over time and it shows. We want someone who can design the next version of it, build the hard parts personally, and bring the rest of the company along.

This is a hands-on role. You'll also be the person other teams come to when they need to know how data should move at Faire.

What you'll do

Set the technical direction for how data moves from production systems into our analytical stores, and own the roadmap to get there over the next couple of years.

Build the CDC and streaming ingestion layer: CockroachDB changefeeds and MySQL binlogs into Kafka, then into Iceberg tables on S3. You'll be responsible for the hard details like ordering, deduplication, late data, schema changes, and backfills.

Implement data contracts and quality checks throughout our platform

Put real ownership and SLAs on the datasets the business runs on, and wire quality checks into the platform with tools like Anomalo and Monte Carlo so we hear about broken data before a dashboard or a model does.

Run Airflow and Fivetran well, and have an opinion about what we should keep buying versus what we should build.

Own reliability for the platform: SLOs, on-call, incident reviews, and the follow-through so the same thing doesn't break twice.

Work with the senior engineers, data scientists, and analysts who depend on this platform, and lead the migration of existing pipelines onto the new one without breaking wh
[…]
ble paid time off, plus company-wide recharge days

• Paid parental leave up to 16 weeks
• Comprehensive health coverage, with options varying by location
• Fertility and family-building benefits through Carrot, including a lifetime reimbursement allowance
• Mental health support and coaching through Modern Health
• Stipends to support your professional development, wellness, and work from home needs
• Employer-sponsored retirement plan, dependent on country of employment

Faire was founded in 2017 by a team of early product and engineering leads from Square. We’re backed by some of the top investors in retail and tech including: Y Combinator, Lightspeed Venture Partners, Forerunner Ventures, Khosla Ventures, Sequoia Capital, Founders Fund, and DST Global. We have headquarters in San Francisco and Kitchener-Waterloo, and a global employee presence across offices in Toronto, London, and New York. To learn more about Faire and our customers, you can read more on our blog .

Faire provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, genetics, sexual orientation, gender identity or gender expression.

Faire is committed to providing access, equal opportunity and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. Accommodations are available throughout the recruitment process and applicants with a disability may request to be accommodated throughout the recruitment process. We will work with all applicants to accommodate their individual accessibility needs. To request reasonable accommodation, please fill out our Accommodation Request Form ( https://bit.ly/faire-form)

Privacy

For information about the type of personal data Faire collects from applicants, as well as your choices regarding the data collected about you, please visit Faire’s Privacy Notice (https://www.faire.com/privacy)