Data engineer - Remote (US) Job at BrightCrew, New York, NY

Y2lGSk0zNUMwNUYxMmdjWDJNRHRhR05o
  • BrightCrew
  • New York, NY

Job Description

Data engineer - Remote (US)

Are you a data engineer who thrives on building robust pipelines and solving complex data challenges?

In this role, youll own the critical data infrastructure that powers pricing models and marketplace insights by ingesting transaction and listing data from dozens of external marketplaces. Youll be responsible for ensuring data pipelines deliver fresh, accurate information that drives pricing decisions, market analytics, and business intelligence across the platform.

What Youll Do

  • Design, optimize, and own data pipelines that scrape, process, and ingest transaction and listing data from major auction houses and marketplaces.
  • Build comprehensive monitoring and alerting systems to track latency, uptime, and coverage metrics across all data sources.
  • Continuously improve data infrastructure by modernizing storage and processing technologies, reducing manual interventions, and optimizing for cost, performance, and reliability.
  • Partner with internal teams to understand data usage patterns and ensure pipelines deliver clean, standardized data that meets product requirements.

This Role Is a Perfect Fit If You

  • Care deeply about data quality and know that extraction is only the beginningthe real value comes from delivering clean, usable data.
  • Thrive in a startup environment where you can make an immediate impact and own critical systems end-to-end.
  • Prefer an incremental approach to improvements, guided by evidence-based decisions rather than wholesale replacements.
  • Are intellectually curious about how data flows through systems and passionate about automation opportunities.
  • Want to work at the intersection of data engineering and product, seeing directly how your pipelines impact business outcomes.

What You Bring to the Table

Must-Haves

  • 3+ years of experience in data engineering or related fields
  • Strong Python proficiency with at least 3 years of hands-on experience
  • Proven experience with large-scale data processing using dataframe technologies (Pandas, Polars, PySpark, or similar)
  • Hands-on experience with pipeline orchestration tools (Airflow, Dagster, or similar DAG-based systems)
  • Track record of owning at least one data pipeline end-to-end within the past 2 years
  • Solid SQL skills for data analysis and transformation
  • Previous startup experienceyou understand the pace and adaptability required in a fast-moving environment
  • A pragmatic mindset focused on delivering value incrementally rather than chasing perfection

Nice-to-Haves

  • Experience with web scraping technologies (Selenium, Puppeteer, Beautiful Soup)
  • Familiarity with data infrastructure and cloud services (AWS preferred)
  • Interest in or knowledge of trading cards, collectibles, or alternative asset markets
  • Experience with LLM-based automation tools for data extraction and processing

Our Client is on a mission to unlock the true value of alternative assets starting with the $5B trading-card market. Collectors can buy, sell, vault, and even finance their cards all in one seamless platform, making it easier than ever to treat collectibles like investable assets. Backed by world-class investors such as Stripe and Coinbase along with legendary athletes like Tom Brady they are building the future of this market. 

If you are looking for the next challenging and rewarding career step - apply today!

Job Tags

Immediate start,

Similar Jobs

HB Travels

Travel Coordinator Job at HB Travels

 ...About Us We are a professional travel services company dedicated to creating seamless...  ...organized and customer-focused Travel Coordinator to join our team. In this role, you will...  ...group travel planning, events, and corporate travel needs when required. Stay current... 

Wolkerstorfer Company, Inc.

Production Assistant Job at Wolkerstorfer Company, Inc.

The Job:~Assisting line operators with assorted duties which include, but are not limited to: prepping, racking, packing, and moving parts~Career potential If interested, you could learn how to operate the line and process partsYou:~Attention to detail~Self... 

Fun Town RV

Warehouse Associate Job at Fun Town RV

 ...diploma or equivalent. Strong computer skills and the ability to work with inventory systems. Experience in shipping, receiving,...  ...part of a company that values hard work and dedication, apply today! Fun Town RV is an Equal Opportunity Employer. All qualified... 

VP Management

Night Audit Hazard Hotel Job at VP Management

Job Summary:The Night Audit at Hazard Hotel is responsible for overseeing and managing all aspects of the hotel during the night shift. This is a full-time, individual contributor position...  ...security, maintenance, and housekeeping.- Ensure compliance with all hotel... 

Kanak Elite Services Inc

React Developer Job at Kanak Elite Services Inc

 ...job. The MUST be willing to be onsite 3 days a week in Sunnyvale, CA, and the expenses for this are NOT paid. React Developer React Developers Must have works for Walmart already. If you have not, we cannot consider your resume at this time....