ETL Job Scheduling

ReadyWorks uses the Windows Task Scheduler on the server to manage ETL job execution.

How Scheduling Works

1. Scheduled Tasks in Windows:
   • For each schedule type (Hourly, Daily, Weekly), there is a corresponding Windows scheduled task.
   • These tasks are set up to run at specific times and intervals.
   • When triggered, they execute a PowerShell script that runs the ETL jobs assigned to that schedule.
2. Execution Order:
   • Within each schedule, ETL jobs run in the order specified by their Order setting.
   • This ensures that jobs with dependencies run in the correct sequence.
3. Cron Jobs Execution:
   • After ETL jobs complete, cron jobs (such as data mappings and custom scripts) are executed.
   • Cron jobs are also scheduled and ordered, similar to ETL jobs.

Viewing and Managing Scheduled Tasks

• Action:
  • Log into the server where ReadyWorks is installed.
  • Open Task Scheduler.
  • Locate the ReadyWorks folder to see the scheduled tasks.
• Tip: Only system administrators with server access can modify these tasks.

Managing ETL Jobs in ReadyWorks

Activating and Deactivating Jobs

• Activate a Job:
  • Set the Active status to Yes.
• Deactivate a Job:
  • Set the Active status to No.
• Tip: Deactivate jobs that are no longer needed to prevent unnecessary processing.

Editing ETL Jobs

• Action:
  • Navigate to ETL Jobs.
  • Click on the job you want to edit.
  • Modify settings as needed (e.g., schedule, SQL query).
• Tip: Document changes for future reference.

Monitoring ETL Jobs

• Check Logs:
  • Review logs in ReadyWorks to verify job execution.
• Use Reports:
  • Generate reports to monitor data imports and identify issues.
• Set Notifications:
  • Configure alerts for job failures or errors.