Join as a hands-on StarRocks Engineer to architect and optimize large-scale deployments for real-time analytics. Responsibilities include schema modeling, performance tuning, incident resolution, and ensuring operational excellence in multi-tenant environments.
We are seeking a hands-on StarRocks Engineer to join our Developer Observability team. You will architect, operate, and optimize large-scale StarRocks deployments powering real-time analytics and observability dashboards. This role requires deep expertise in StarRocks internals, performance tuning, operational excellence, and integration with modern data pipelines.
Nice to Have
- Design, build, and maintain production-grade StarRocks clusters for high-volume, low-latency analytics workloads.
- Lead schema/data modeling for clickstream, dimensional, and time-series data, ensuring deduplication, upserts, and efficient partitioning.
- Optimize query performance using materialized views, indexes, and advanced StarRocks features (vectorization, pipeline execution).
- Diagnose and resolve high-severity incidents, leveraging logs, metrics, and profiling tools; implement permanent fixes and guardrails.
- Plan and execute capacity planning, scaling, and resource management for multi-tenant environments.
- Develop and enforce backup, disaster recovery, and upgrade strategies with minimal downtime.
- Implement security best practices: AuthN/AuthZ, encryption, auditing, and data masking.
- Collaborate with engineering and SRE teams to define SLOs, observability dashboards, and alerting for StarRocks infrastructure.
- Proven experience architecting and operating StarRocks (or similar OLAP) clusters at scale (10B+ events/day, TB-PB data).
- Deep understanding of StarRocks FE/BE architecture, storage engines, compaction, and cost-based optimizer.
- Expertise in schema design, partitioning, bucketing, and index/encoding strategies for hot/cold data tiers.
- Strong troubleshooting skills: root cause analysis, performance profiling, and incident response.
- Experience with ingestion pipelines (Kafka/Kinesis), exactly-once semantics, and CDC-based upserts.
- Familiarity with materialized view design, refresh policies, and query rewrite mechanics.
- Operational excellence: backup/restore, rolling upgrades, resource governance, and multi-tenant management.
- Security and compliance: LDAP/OIDC integration, RBAC, encryption, and sensitive data handling.
- Excellent communication skills; ability to diagram architectures and explain trade-offs to technical and non-technical stakeholders.
Nice to Have
- Experience with other OLAP systems (ClickHouse, Druid, Pinot) and comparative benchmarking.
- Contributions to StarRocks open source or related communities.
- Cloud-native deployment experience (Kubernetes, autoscaling, infrastructure-as-code).
Top Skills
Kafka
Kinesis
Kubernetes
Starrocks
Atlassian New York, New York, USA Office
Atlassian believes the future of work is distributed and offers our people the flexibility to help them do what’s important to them. And with few exceptions, we hire people anywhere we have a legal entity as long as they have eligible work rights and sufficient team time zone overlap.
Similar Jobs at Atlassian
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Program Manager will oversee data governance programs, managing delivery and stakeholder communication, while ensuring compliance and strategic partnerships.
Top Skills:
Atlassian SolutionsConfluenceJIRAJira Service ManagementLoomWorkday
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Lead the architectural direction and technical strategy for platform engineering, mentor engineers, and manage large-scale cloud-native projects with a strong focus on collaboration and operational excellence.
Top Skills:
AWSCloud-Native TechnologiesDistributed SystemsSaaS
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
Develop and enhance monetisation strategies for software products while collaborating with teams to achieve optimal performance and growth.
What you need to know about the NYC Tech Scene
As the undisputed financial capital of the world, New York City is an epicenter of startup funding activity. The city has a thriving fintech scene and is a major player in verticals ranging from AI to biotech, cybersecurity and digital media. It also has universities like NYU, Columbia and Cornell Tech attracting students and researchers from across the globe, providing the ecosystem with a constant influx of world-class talent. And its East Coast location and three international airports make it a perfect spot for European companies establishing a foothold in the United States.
Key Facts About NYC Tech
- Number of Tech Workers: 549,200; 6% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Capgemini, Bloomberg, IBM, Spotify
- Key Industries: Artificial intelligence, Fintech
- Funding Landscape: $25.5 billion in venture capital funding in 2024 (Pitchbook)
- Notable Investors: Greycroft, Thrive Capital, Union Square Ventures, FirstMark Capital, Tiger Global Management, Tribeca Venture Partners, Insight Partners, Two Sigma Ventures
- Research Centers and Universities: Columbia University, New York University, Fordham University, CUNY, AI Now Institute, Flatiron Institute, C.N. Yang Institute for Theoretical Physics, NASA Space Radiation Laboratory
