Senior Software Engineer - Crawler
Jornada completa
ZoomInfo
Responsibilities
- Design and implement scalable, fault-tolerant web crawling and extraction pipeline components.
- Write clean, production-grade Java and Python code.
- Build and operate large-scale ETL/ELT pipelines for data extraction and transformation.
- Work with GCP and AWS cloud infrastructure, primarily on GKE.
- Improve observability, reliability, and operational excellence across contributed systems.
- Partner with product and data science teams to deliver solutions.
- Contribute to code reviews, documentation, and knowledge sharing.
- Keep current with web technologies, anti-crawling mechanisms, and AI-powered extraction approaches.
Requirements
- At least 5 years of professional software engineering experience building production systems.
- Strong knowledge of algorithms, data structures, concurrency, and distributed systems.
- Proficiency in Java and/or Python.
- Experience owning features end-to-end from design through deployment and operation.
- Experience making component-level architectural decisions.
- Hands-on experience with cloud data warehouses such as BigQuery or Snowflake.
- Experience designing and operating large-scale ETL/ELT pipelines.
- Experience with orchestration tools such as Apache Airflow.
- Experience with streaming or event-driven systems such as Apache Kafka.
- Production experience on GCP or AWS, with GCP preferred.
- Hands-on experience with Kubernetes, including GKE or EKS, for distributed workloads.
- Familiarity with infrastructure-as-code tools such as Terraform.
- Strong communication, pragmatic problem-solving, adaptability, and self-direction.
- Web crawling at scale, Scrapy, proxy infrastructure, anti-bot evasion, SERP extraction, AI/LLM-based extraction, or B2B data-company experience is preferred.
Benefits
- Remote work arrangement is indicated by the LI-REMOTE designation.
- Comprehensive benefits are offered, along with holistic mind, body, and lifestyle well-being programs.
Vacante publicada el 1 dia atras
Empleos similares que podrían interesarleBasado en la vacante Senior Software Engineer - Crawler en Teletrabajo
- ...India) creates quality solutions for its customers by combining software, back office, and knowledge processing operations to fulfill... ...Summary We are seeking a highly motivated and skilled Software Engineer with 5–8 years of professional experience in designing,...SeniorTiempo completo
- ...across PC and IoT technologies. Our teams partner with specialist engineers from major silicon companies to integrate next-generation... ...integration for the latest IoT and server-class hardware platforms and software stacks Work with partners to deliver a delightful,...SeniorPrácticaTiempo completoRemoto
- ...and production inference workflows. Partner with application engineering teams to integrate AI into code review, test generation,... ...technical leadership. Requirements ~6+ years of professional software engineering experience or equivalent, including shipping production...SeniorTiempo completoRemoto
- ...external code, and deployed instrumentation. Apply and coach engineering best practices for robust, testable, and composable code.... .... Requirements At least 5 years of experience as a software engineer, data scientist, or ML engineer; most successful candidates...SeniorPrácticaTiempo completoRemoto
- ...watchdog timing, thermal limits, and voltage thresholds. Mentor engineers on embedded safety patterns, driver architecture, RTOS... ...experience or a PhD. Deep experience developing embedded C/C++ software with advanced language features, clean abstractions, interface...SeniorTemporalTiempo completoEmpleo permanentePatrocinio de visaTrabajar en la oficinaInicio inmediato
- ...working with brilliant people. You are an accomplished senior Python programmer that enjoys challenging projects in... ...the industry's pioneers in open source with intelligent engineers at every level from engineer to CTO and CEO level. At Canonical we've honed our remote...SeniorTiempo completoRemoto
- ...30%+ at ~$2B ARR is that we need great engineers everywhere, and we have the room to shape... ...NYSE: IOT) sits at the center of hardware, software, AI, and the physical world. The... ...is broad and flexible: we're hiring from Senior through Principal, across platform and product...SeniorPrácticaTiempo completoRemotoTrabajo híbridoHorario flexible
- ...won’t just be writing code; you’ll be shaping the future. As a Software Engineer at Xapo, you will design, build, and deploy high-impact... ...design to production operations, all while being mentored by senior engineers. You could join one of our dynamic, business domains...SeniorTiempo completoRemoto
- ...with customers and subject-matter experts, and take ownership of product outcomes. Requirements Four or more years of software engineering experience, most of it in frontend work, at companies with strong engineering practices. Strong frontend capability in either...PrácticaTiempo completoPatrocinio de visaTrabajar en la oficinaRemotoVisa de trabajo
- ...company founded by former Google Cloud leaders, architects, and engineers. We are seeking candidates with significant experience in... .... What we need... ~5+ years of experience working in a Software Engineering capacity ~ Excellent knowledge and experience with...TemporalTiempo completoContratoRemoto
- ...our platform scales globally, we're looking for people who can turn complex systems into practical, working solutions. As a Software Engineer in Partner Engineering, you’ll play a pivotal role in shaping technical solutions that directly impact our top-tier partners....Tiempo completoCASRemotoHorario flexible
- ...This is the general track for Engineering Director at Canonical, apply here if you are confident... ...staff engineers. Canonical’s largest software products are built by multiple teams... ...of the result. Even though this is a senior management position, managing managers,...SeniorTiempo completoRemoto
- ...We’re looking for a Software Engineer who would contribute to PVcase software and would not be afraid of heights (at least career ones)! You will play an important role in our exciting journey while accelerating the global transition to clean energy. Participate and...Trabajo de veranoPrácticaTiempo completoTrabajar en la oficinaRemotoHorario flexible
- ...Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform... ...initiatives such as public cloud, data science, AI, engineering innovation, and IoT. Our customers include the world's leading...Tiempo completoTrabajar en la oficinaDesde casaRemotoTurno de tardeTurno de nocheFin de semanaLunes a viernes
- ...Use AI-assisted development tools, including GitHub Copilot. Participate in production support and on-call rotations. Mentor engineers while remaining hands-on with development. Requirements At least 8 years of Java development experience. Strong expertise...SeniorTiempo completoRemoto
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation and IoT. Our customers... ...software, provide robust upgrade paths and engineer the future of Ubuntu. Ubuntu is not just...FreelanceTiempo completoTrabajar en la oficinaRemoto
210 000 - 260 000 USD por ano
...That's why you can do here what you can never do at a legacy software company. move fast and prove it, not theorize it. We think from... ...operates. What You'll Be Doing : Lead a small team of engineers, providing technical mentorship, code review, and...Tiempo completo- ...Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform... ...initiatives such as public cloud, data science, AI, engineering innovation, and IoT. Our customers include the world's leading...Tiempo completoTrabajar en la oficinaDesde casaRemoto
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation, and IoT. Our customers... ...and growing. We are hiring a Software Engineer, Sustaining Engineering for ... ...a...Tiempo completoTrabajar en la oficinaDesde casaRemoto
- ...leading provider of open source software and operating systems to the... ...cloud, data science, AI, engineering innovation, and IoT. Our customers... ...This is a general track for Senior+ (Senior/Staff/Principal)... ...them. At Canonical a Senior+ Engineer is not only an outstanding software...SeniorTemporalTiempo completoTrabajar en la oficinaDesde casaRemoto
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation and IoT. Our customers... ...private infrastructure. As a software engineer on the team, you'll collaborate on end-to...TemporalTiempo completoDesde casaRemoto
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation, and IoT. Our customers... ...an exceptional security-focused software engineer, passionate about open source, and excited...Tiempo completoTrabajar en la oficinaRemoto
- ...owning a complex data system end-to-end over a multi-year horizon and making significant architecture decisions. Senior data or detection engineering experience at scale. Deep fluency with SQL, Python or an equivalent language, data pipelines, and scheduled and event...SeniorTiempo completoRemoto
- ...About The Role Join the cutting-edge team building the data platform that powers fleet-scale humanoid robotics. As a Staff Software Engineer on our Data Platform team, you will play a pivotal role in designing, developing, and maintaining the infrastructure that enables...TemporalTiempo completoCASRemotoTrabajo híbridoHorario flexible
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation and IoT. Our customers... ...software, provide robust upgrade paths and engineer the future of Ubuntu. Ubuntu is not just...FreelanceTiempo completoTrabajar en la oficinaRemoto
- ...with Linux systems, package management, build systems, release engineering, or artifact pipelines. Bachelor's degree or equivalent in... ...experience includes dependency and vulnerability assessment, software supply chain security, SBOMs, signatures, provenance, CVE reports...Tiempo completoDesde casa
- ...Canonical is a leading provider of open source software and operating systems to the global... ...such as public cloud, data science, AI, engineering innovation, and IoT. Our customers... ...opportunity for an exceptional software engineer passionate about open source software, Linux...Tiempo completoTrabajar en la oficinaDesde casaRemoto
- ...Improve application performance, code quality, accessibility, and developer experience. Provide technical guidance to Software Engineers I and II through code reviews, pairing, and design feedback. Collaborate with Product, Design, and QA to align technical implementation...Tiempo completoRemoto
- ...security team to align the application with organizational security standards. Collaborate directly with the client engineering team as an embedded engineer. Requirements Strong C# and .NET experience, including advanced C# features and nullable reference types....SeniorTiempo completoDesde casaRemotoTurno de noche
- Responsibilities Design, automate, validate, and deliver the complete lifecycle of customer compute environments from provisioning through upgrades, recovery, and decommissioning. Use AI to automate and accelerate infrastructure delivery and operations. Provision...SeniorTiempo completo
¿Desea recibir más vacantes?
Suscríbase y reciba vacantes similares a Senior Software Engineer - Crawler. ¡Sea el primero en aplicar!
