Senior BigData/Spark Solution Architect - Can join by April

Job DescriptionRole requires experience in delivering end-to-end data driven applications leveraging modern tools and technologies with focus on architecture, solutioning, and design aspects in the end-to-end data management.Mandatory Skills:Cloud (AWS / Azure / GCP), Databricks, Spark, PySpark, SQL & Data Warehouse What we look for:Total 12+ years of experience in delivering data driven applications using Big Data technologies such as Spark, Kafka, Cloud, Data Lakes, Data Warehouse in a customer-facing, technical architecture, or consulting role.Minimum of 6+ years of experience working on Big Data Architectures independently.Minimum 5+ years of experience working with any database/data warehouse platforms such as Oracle, Teradata, Snowflake, Red Shift etc.Strong experience working in the Databricks ecosystem.Comfortable writing code in either Python or Scala.Experience working across Cloud Platforms (GCP / AWS / Azure)Documentation and white-boarding skills.Experience working with clients and managing conflicts.Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects.Experience building data engineering solutions covering ingestion, integration and provisioning using either tools or open standards. Experience conducting rapid prototypes or proof of concept for picking right tool or service for a specific functional / non-functional requirement.Experience with developing data platforms architecture in one or more of the Cloud platforms - Azure, GCP and AWSExperience gathering technology requirements from different stakeholders and translating to optimal design.Experience building solutions / frameworks / accelerators or automation experience in data management projects.Familiarity with different services and respective performance and cost implications in one or more Cloud platformsExperience with Optimizing different data & ML pipelines for performance, cost and reusability.Worked with modern ETL and Data Movement tools for different patterns - real-time, near real-time and batch.Strong knowledge of continuous integration, static code analysis and test-driven development Experience in delivering projects in a highly collaborative delivery model with teams onsite and offshore. Ability to iteratively design and develop solutions from a concept / idea.Able to work in a rapidly changing business environment and adapt to the fast-paced environment quickly.Strong verbal and written communications skills are a must, as well as the ability to work effectively across internal and external organizations. Impact you will have (Roles & Responsibilities):You will work on a variety of impactful customer technical projects which may include building reference architectures, how to do and production grade MVP's.Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications.Consult on architecture and design; bootstrap or implement strategic customer projects which leads to a customers' successful understanding, evaluation, and adoption of Databricks & Data Engineering.Ideate, design, develop and deliver data engineering solutions and accelerators with the clear objective of helping our clients generate more value from less.Architect data management platform one or more Cloud platform based on functional and non-functional requirements.Review the architecture, solution and design against set parameters and provide recommendations.Work with internal stakeholders and client teams in defining robust technology standards, guidelines, and best practices.Estimate cost of the platform and cost of ownership with some reasonable assumptionsOptimize the data pipelines for performance and cost.Rationalize design decisions with objective proof points.Work with different stakeholders such as IT leadership on solution design and architecture About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from their analytics investments. The aim is to bridge the gap between insight delivery and value realization by providing customers with a differentiated approach to data and analytics through tailor-made solutions. Tredence is 2,200+ employees strong with offices in San Jose, Foster City, Chicago, London, Toronto, and India (Bangalore, Pune, Chennai, Gurugram & Kolkata), with the largest companies in retail, CPG, hi-tech, telecom, healthcare, travel, and industrials as clients. As we complete 11 years of Tredence this year, we are on the cusp of an ambitious and exciting phase of expansion and growth. Tredence recently closed a USD 175 million Series B funding, which will help us build on growth momentum, strengthen vertical capabilities, and reach a broader customer base.Apart from our geographic footprint in the US, Canada & UK, we plan to open offices in Kolkata. In 2023, we also plan to hire more than 1000 employees across markets. Tredence is a Great Place to Work (GPTW) certified company that values its employees and creates a positive work culture by providing opportunities for professional development and promoting work-life balance.At Tredence, nothing is impossible; we believe in pushing ourselves to limitless possibilities and staying true to our tagline, Beyond Possible. PRB