Scheduling Data Extraction

With Schedule, you can set up data extraction at specified time intervals to automatically extract data. You can create more than one schedule depending on how often you want to source data. Schedules can be set as recurring if they need to be repeated at fixed intervals. Once the extraction in complete data gets automatically delivered to the configured destination.

Creating a schedule for a report:

• Go to Schedule tab.
• Fill in the necessary details:
  • Schedule name: The name of the schedule.
  • Start date and time: When the schedule will start.
  • Frequency (repeat): How often the schedule should repeat (hourly, daily, weekly).
  • Custom parameters: Set up custom parameters as per your requirement.
• Click on “Schedule” to create the schedule.

After the schedule has been created, it will be displayed on the right side of the schedule page.

Managing schedules

• Edit : You can edit the schedules based on your requirements.
• Pause : You can pause the schedule temporarily and unpause it when needed.
• Delete : You can delete the schedule when it's no longer required.

Setting up parameters

Parameters are configured based on customer requirements when the report is initially set up. The parameter values can be changed during execution.

For example, if a crawler is designed to collect product data for a specific category on Amazon, the customer can specify the desired category as input. This allows them to control which product category is collected during each run. Additionally, this can be configured as part of the scheduled settings.

Note

• Changing the project or report status to cancelled will pause all the schedules in the report.

What frequencies are supported for schedule?

• hourly
• daily
• weekly
• monthly

How can I identify runs triggered by schedule?

• Runs triggered by schedule have sch tag in datasets page.