Software Engineer, Python (SDE-1)
Job details
Position OverviewWe are a seed-funded startup focused on using state-of-the-art AI technologies to revolutionize the credit industry. Our team consists of experts in machine learning and software engineers who have worked at top-tier US tech companies like Apple, Amazon, etc , and we are passionate about using AI to improve access to credit information for businesses. We have the product on the market, the first clients, and sufficient runway. We are seeking a talented Software Engineer with a specialization in Python and interest in Web Scraping. In this role, you will be at the forefront of extracting critical data from various online sources, leveraging your expertise in Python and web scraping technologies to drive our data-driven solutions.Key ResponsibilitiesWeb Scraping and Data Collection: Develop, deploy, and maintain web scraping scripts and tools using Python to gather essential data from multiple online sources.Data Processing and Management: Process and structure the scraped data, ensuring its relevance, accuracy, and readiness for analysis.Automation and Optimization: Automate scraping tasks for efficient and regular data updates. Optimize scripts for performance, scalability, and reliability.Collaborative Data Strategy Development: Work closely with data analysts and engineers to integrate scraped data into broader data strategies and systems.Technical Problem Solving: Address challenges related to dynamic web content, anti-scraping measures, and large-scale data extraction.Documentation and Reporting: Create detailed documentation for the scraping processes and provide regular updates on scraping operations.QualificationsProven expertise in Python and it's ecosystem as well as best practices, with a strong focus on fundamental Python tools and practices (Mypy, pydantic, etc) as well as scraping libraries (Scrappy, etc).Experience in building and managing automated web scraping systems.Basic understanding of web technologies (HTML, CSS, JavaScript) and familiarity with network protocols.Knowledge in handling various data formats (JSON, XML, CSV).Ability to write clean, maintainable, and efficient code.Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field.Ideally 1-2+ years professional experience.Strong problem-solving skills and the ability to work independently in a fast-paced environment.Experience with cloud platforms, particularly AWS, is a plus.Being scrappy and nerdy about programming and python like the founding team!What We OfferSignificant impact on the company's data strategy and infrastructure.A collaborative, flexible, and dynamic work environment.Competitive salary and benefits package. PRB
Apply safely
To stay safe in your job search, information on common scams and to get free expert advice, we recommend that you visit SAFERjobs, a non-profit, joint industry and law enforcement organization working to combat job scams.
