Integrate the Apify API with the AWS API

Setup the Apify API trigger to run a workflow which integrates with the AWS API. Pipedream's integration platform allows you to integrate Apify and AWS remarkably fast. Free for developers.

Popular Ways to Connect Apify with AWS#

Run Actor with Apify API on New Scheduled Tasks from AWS API

AWS + Apify

Try it

Run Actor with Apify API on New SNS Messages from AWS API

AWS + Apify

Try it

Scrape Single URL with Apify API on New Scheduled Tasks from AWS API

AWS + Apify

Try it

Scrape Single URL with Apify API on New SNS Messages from AWS API

AWS + Apify

Try it

Set Key-Value Store Record with Apify API on New Scheduled Tasks from AWS API

AWS + Apify

Try it

Popular Apify and AWS Triggers#

New Finished Actor Run (Instant) from the Apify API

Emit new event when a selected actor is run and finishes.

Try it

New Scheduled Tasks from the AWS API

Creates a Step Function State Machine to publish a message to an SNS topic at a specific timestamp. The SNS topic delivers the message to this Pipedream source, and the source emits it as a new event.

Try it

New Finished Task Run (Instant) from the Apify API

Emit new event when a selected task is run and finishes.

Try it

New SNS Messages from the AWS API

Creates an SNS topic in your AWS account. Messages published to this topic are emitted from the Pipedream source.

Try it

New Inbound SES Emails from the AWS API

The source subscribes to all emails delivered to a specific domain configured in AWS SES. When an email is sent to any address at the domain, this event source emits that email as a formatted event. These events can trigger a Pipedream workflow and can be consumed via SSE or REST API.

Try it

Popular Apify and AWS Actions#

Run Actor with the Apify API

Performs an execution of a selected actor in Apify. See the documentation

Try it

Scrape Single URL with the Apify API

Executes a scraper on a specific website and returns its content as text. This action is perfect for extracting content from a single page.

Try it

CloudWatch Logs - Put Log Event with the AWS API

Uploads a log event to the specified log stream. See docs

Try it

Set Key-Value Store Record with the Apify API

Create or update a record in the key-value store of Apify. See the documentation

Try it

DynamoDB - Create Table with the AWS API

Creates a new table to your account. See docs

Try it

Overview of Apify#

The Apify API unleashes the power to automate web scraping, process data, and orchestrate web automation workflows. By utilizing Apify on Pipedream, you can create dynamic serverless workflows to manage tasks like extracting data from websites, running browser automation, and scheduling these jobs to run autonomously. It integrates smoothly with Pipedream's capabilities to trigger actions on various other apps, store the results, and manage complex data flow with minimal setup.

Connect Apify#

import { axios } from "@pipedream/platform"
export default defineComponent({
  props: {
    apify: {
      type: "app",
      app: "apify",
    }
  },
  async run({steps, $}) {
    return await axios($, {
      url: `https://api.apify.com/v2/users/me`,
      headers: {
        Authorization: `Bearer ${this.apify.$auth.api_token}`,
      },
    })
  },
})

Overview of AWS#

The AWS API unlocks endless possibilities for automation with Pipedream. With this powerful combo, you can manage your AWS services and resources, automate deployment workflows, process data, and react to events across your AWS infrastructure. Pipedream offers a serverless platform for creating workflows triggered by various events that can execute AWS SDK functions, making it an efficient tool to integrate, automate, and orchestrate tasks across AWS services and other apps.

Connect AWS#

import AWS from 'aws-sdk'

export default defineComponent({
  props: {
    aws: {
      type: "app",
      app: "aws",
    }
  },
  async run({steps, $}) {
    const { accessKeyId, secretAccessKey } = this.aws.$auth
    
    /* Now, pass the accessKeyId and secretAccessKey to the constructor for your desired service. For example:
    
    const dynamodb = new AWS.DynamoDB({
      accessKeyId, 
      secretAccessKey,
      region: 'us-east-1',
    })
    
    */
  },
})