Data Engineer PK (Python/PySpark/AWS Glue/Amazon Athena/SQL/Apache Airflow)

Job descriptionLet’s be direct: We’re looking for a technical powerhouse. If you’re the developer who: Is the clear technical leader on your team Consistently solves problems others can’t crack Ships complex features in half the time it takes others Writes code so clean it could be published as a tutorial Takes pride in elevating the entire codebase Then we want to talk to you. This isn’t a role for everyone, and that’s by design. We’re seeking developers who know they’re exceptional and have the track record to prove it. What you’ll do Build, optimize, and scale data pipelines and infrastructure using Python, TypeScript, Apache Airflow, PySpark, AWS Glue, and Snowflake. Design, operationalize, and monitor ingest and transformation workflows: DAGs, alerting, retries, SLAs, lineage, and cost controls. Collaborate with platform and AI/ML teams to automate ingestion, validation, and real-time compute workflows; work toward a feature store. Integrate pipeline health and metrics into engineering dashboards for full visibility and observability. Model data and implement efficient, scalable transformations in Snowflake and PostgreSQL. Build reusable frameworks and connectors to standardize internal data publishing and consumption. Job requirementsRequired qualifications 4+ years of production data engineering experience. Deep, hands-on experience with Apache Airflow, AWS Glue, PySpark, and Python-based data pipelines. Strong SQL skills and experience operating PostgreSQL in live environments. Solid understanding of cloud-native data workflows (AWS preferred) and pipeline observability (metrics, logging, tracing, alerting). Proven experience owning pipelines end-to-end: design, implementation, testing, deployment, monitoring, and iteration. Preferred qualifications Experience with Snowflake performance tuning (warehouses, partitions, clustering, query profiling) and cost optimization. Real-time or near-real-time processing experience (e.g., streaming ingestion, incremental models, CDC). Hands-on experience with a backend TypeScript framework (e.g., NestJS) is a strong plus. Experience with data quality frameworks, contract testing, or schema management (e.g., Great Expectations, dbt tests, OpenAPI/Protobuf/Avro). Background in building internal developer platforms or data platform components (connectors, SDKs, CI/CD for data). Additional Information This is a fully remote position. Compensation will be in USD. Work hours are aligned with the EST time zone (9 AM to 6 PM EST) or PT time zone. All done!Your application has been successfully submitted! Other jobs You've already applied for this jobWe appreciate your interest in this position. Unfortunately, you have already applied for this job.