We’re seeking a deeply experienced Principal Engineer to lead architecture and engineering strategy across our Risk, Fraud, and Disputes platforms. This is a high-impact, hands-on technical leadership role focused on building ultra-low-latency, high-availability (99.999%), and scalable systems that power real-time transaction processing, fraud detection, and dispute workflows processing hundreds of billions of dollars.
You'll partner with product, platform, and data/ML teams to deliver resilient infrastructure, embed AI/LLM automation, and ensure secure, compliant integrations with global payment networks and identity vendors.
We work Flexible First. This role can be performed remotely anywhere within the United States or from our headquarters in Oakland, CA. We’d love for you to join us!
The Impact You’ll Have
- Architect and scale real-time, high-throughput systems for fraud detection, dispute handling, and identity verification.
- Build and optimize systems with sub-50ms latency SLAs to support real-time decisioning across fraud, 3DS, and dispute domains.
- Partner with ML/AI teams to integrate AI/ML pipelines and LLM-powered automation for intelligent classification, summarization, and recommendations.
- Design secure, fault-tolerant systems using event-driven architectures, Kafka, Flink, gRPC, and microservices.
- Designing and launching AI Agents to make step changes in how risk and fraud mitigation is performed
- Integrate with card networks including Visa, Mastercard, Pulse.
- Lead infrastructure-as-code implementation with Terraform, and scale CI/CD pipelines using modern tools
- Implement observability, SLOs, tracing, and operational controls to ensure resilience and performance under high load.
- Drive integrations with specialized 3rd-party providers for data enrichment services and compliance automation
- Mentor senior engineers, review high-risk architecture, and help steer technical decision-making across product teams.
- Apply and evangelize modern best practices in your software designs and implementations to increase the platform's reliability, resiliency, and scalability.
Who You Are
- 15+ years of software engineering experience, including designing, building, and operating real-time distributed systems at scale.
- Team-oriented approach – can effectively lead a project, participate as an influential team member, and work cross-functionally with other organizations.
- Experience partnering with product teams to ideate and bring innovative solutions to market
- Strong engineering skills in Java with solid knowledge of microservices, message queues, circuit breakers, retries, rate-limiting and asynchronous systems.
- Hands-on experience with CI/CD systems, infrastructure-as-code using Terraform, containerization (Docker) and DevSecOps best practices.
- Proven experience with AI/ML and LLMs in production environments, especially for risk decisioning flows or agentic automation.
- Deep expertise in cloud-native architectures on AWS, including services like Lambda, ECS, and EKS; real-time data streaming using Kafka; and experience building high-performance APIs (REST/gRPC) under tight latency SLAs
- Knowledge of card network specifications.
- Hands-on technical ability to write code, debug issues, or write queries to unblock teams, validate new ideas, and integrate emerging technologies.
- Proficiency in SQL and data analysis using tools like MySQL, Snowflake, and scripting languages.
Nice to Haves
- Deep experience in risk, fraud, 3DS, or dispute platforms, with high sensitivity to performance, reliability, and compliance.
- Demonstrated success partnering with ML and fraud teams to deploy real-time models into production (e.g. SageMarker, Vertex AI, or Ray Serve) with tight latency constraints.
- Integration experience with U.S. card networks and fraud/identity platforms to incorporate inline risk signals during authorization.
- Proficiency with observability tools such as Datadog and AWS X-Ray to diagnose latency and system issues.
- Familiarity with KYB/KYC, AML, and 3rd-party compliance and Data enrichment vendor integration.
Recruiter For This Role:
- Kayla Osuna
Typical process:
- Application Submission
- Recruiter phone call
- Hiring manager video call
- Virtual “Onsite” consisting of 4-5, 45 min calls
- Offer!
Compensation and Benefits
Marqeta is a Flex First company which allows you to choose your best working environment, whether that be from home or at a company office. To support Flex First, we calibrate pay to a competitive value according to working location. Compensation is aligned according to three tiers within the United States:
- National: A baseline tier that applies to most of the geographic territory of the United States.
- Premium: Slightly elevated from the National tier, and oriented toward a narrower set of higher cost-of-living areas, such as Los Angeles CA and Seattle WA
- Premium Plus: A tier for the most expensive working areas, like the San Francisco Bay area and New York City.
Visit this page or consult with a Recruiter to determine which tier would be applicable to you.
When determining salaries, we consider several factors including, but not limited to, skills, prior experience, and work location. The new-hire base salary range for this position is:
- National: $206,100 - $257,600
- Premium: $223,100 - $278,900
- Premium Plus: $242,500 - $303,100
We also believe in recognizing the contributions of our people. That's why we award annual bonuses to eligible employees, rewarding both individual performance and the success of the entire company.
Along with monetary compensation, Marqeta offers
- Multiple health insurance options
- Flexible time off – take what you need
- Retirement savings program with company contribution and after tax contributions
- Equity in a publicly-traded company and an Employee Stock Purchase Program
- Family-forming benefits, fertility support, and up to 20 weeks of Parental Leave
- Free therapy sessions, financial and professional coaching, and legal advice
- Monthly stipend to support our remote work model
- Annual “development dollars” to support our people growth and development