Crawler PNG and SVG Icon
AWS Glue Crawler is a component that automatically scans data sources, infers schemas, and creates metadata tables in the AWS Glue Data Catalog.
Last Modified: August 29, 2025
16px
32px
48px
64px
Details
Key Features
- Automatically scans data sources to detect schema and metadata.
- Populates AWS Glue Data Catalog entries.
- Supports incremental crawls for efficiency.
- Integrates with Amazon S3, RDS, Redshift, and JDBC sources.
Common Use Cases
- Automatically discovering and cataloging new datasets in S3
- Updating schema changes in AWS Glue Data Catalog
- Classifying data by file type and structure for ETL jobs
Explore More Icons
Cloud Directory
Amazon Cloud Directory enables you to build flexible, cloud-native directories for organizing hierarchical data with multiple dimensions and relationships.
Simple Notification Service
Amazon Simple Notification Service (SNS) is a fully managed pub/sub messaging service for sending messages to subscribers over SMS, email, or other protocols.
Chatbot
AWS Chatbot is an interactive agent that helps you monitor and interact with AWS resources from chat platforms like Slack or Microsoft Teams.
Secrets Manager
AWS Secrets Manager helps you securely store, retrieve, rotate, and manage access to sensitive information such as database credentials and API keys.
Elemental MediaTailor
AWS Elemental MediaTailor enables server-side ad insertion for video content, allowing personalized ad experiences across platforms.
Lookout for Metrics
Amazon Lookout for Metrics automatically detects and diagnoses anomalies in business and operational data using ML models.
AMI
Amazon Machine Image (AMI) is a preconfigured template that contains the software configuration (OS, application server, applications) required to launch an EC2 instance.
Verified Access
AWS Verified Access provides secure access to corporate applications without using a VPN by verifying user identity and device posture.
DeepLens
AWS DeepLens is a deep learning-enabled video camera for developers to run ML models locally on edge devices in real time.
rePost Private
AWS re:Post Private offers a secure, private version of the re:Post community within an organization, enabling internal knowledge sharing and collaboration around AWS topics.
Trusted Advisor
AWS Trusted Advisor provides real-time guidance to help you follow AWS best practices for cost optimization, security, and performance.
Forecast
Amazon Forecast is a fully managed service that uses machine learning to generate accurate time series forecasts based on historical data.
Resource Access Manager
AWS Resource Access Manager (RAM) enables you to securely share AWS resources with other AWS accounts or within your organization.
EKS Anywhere
Amazon EKS Anywhere lets you create and operate Kubernetes clusters on your own infrastructure using the same tooling as Amazon EKS in the cloud.
Amazon Rekognition Image
Amazon Rekognition Image is a deep learning-based service that analyzes and detects objects, scenes, and faces in static images.
App Mesh
AWS App Mesh is a service mesh that provides application-level networking to make it easy to monitor and control microservices running on AWS.
Lookout for Equipment
Amazon Lookout for Equipment uses machine learning to detect abnormal equipment behavior and prevent potential failures.
Data Transfer Terminal
AWS Data Transfer Terminal is a user interface that simplifies the secure transfer of files and data to and from AWS services.
Step Functions
AWS Step Functions is a serverless orchestration service that helps you build and coordinate distributed applications using visual workflows.
HealthImaging
Amazon HealthImaging is a service that stores, transforms, and analyzes medical imaging data at scale using cloud-native tools and standards.
Cost Explorer
AWS Cost Explorer is a tool that helps you visualize, understand, and manage your AWS costs and usage over time through interactive charts and reports.
Management Console
The AWS Management Console is a web application for managing AWS services through a user-friendly graphical interface.
Migration Evaluator
AWS Migration Evaluator (formerly TSO Logic) helps build a business case for cloud migration by analyzing on-premises resource utilization and cost projections.
Change Set
AWS CloudFormation Change Sets let you preview changes AWS CloudFormation will make to your stack before executing them.