Data Hub Basic

2 Data Hub Basic Block Configuration

To view the Data Hub Basic block configuration go to the Site Administration menu and select Modules > Blocks > Data Hub. The DH file locations are entered and described on this screen.

It is important to let Remote-Learner staff set up these locations for you so that your user data is put in a secure location that will enable DH Basic to operate correctly. If these locations are blank, please contact your Sales Representative to purchase the DH Basic setup.

Data Hub block configuration
  1. Import file location: This is where files will be placed to be processed by Data Hub. The files placed here will be automatically processed every 30 minutes by default. Files can also be processed immediately by selecting the Save and Process button on the User, Course, and Enrollment tabs. Selecting the Import all button on the General tab will import all three files at once.
  2. Export file location: Export files are processed every 24 hours by default, this time can be changed by the "Export period" setting, see #8 below. Export files can be processed immediately by selecting the 'Export now' button on the General tab. If you don't want to have DH export any files, leave the Export file location field empty.
  3. Log file location: Location of all import and export log files - every time the batch file runs, a log will be written, describing in detail what actions were taken by the import script.
  4. Email notification: Enter the id numbers of users that should be emailed the log files. The system will then email log files to the email associated with the id number. Note that a user's id number must be the same as their username for the notifications to work. This will be fixed in Data Hub 2.0.
Data Hub block configuration screen
  1. Import period: Set the import frequency. An example of the time format is 3d, 4h, 50m. This would import files every 3 days, 4 hours , and 50 minutes.
  2. Create groups and groupings: Automatically create new groups in Moodle courses.
  3. Import date format: The are 3 import date formats, whichever format is selected here must be used in the import files.
    • M/D/Y - MM/DD/YY
    • D-M-Y - DD-MM-YY
    • Y.M.D. - YY.MM.DD
Data Hub block configuration screen
  1. Export period: Set the export frequency. An example of the time format is 3d, 4h, 50m. This would create an export file every 3 days, 4 hours , and 50 minutes.
  2. Unique export file names: This gives each export file a unique time stamp. If this is selected then each export will have a separate file name. If this isn't selected then the previous export file will be replaced when a new export file is processed.
  3. Include all historical data: If this is selected all the completion data for the site is included in the export report each time it is run. If this isn't selected, then only completion data since the last report is included.
  4. Disable cron: This will turn off the standard cron process for Data Hub - this will stop DH from processing files, so please makes sure Remote-Learner support confirms that the DH Cron is operational before this is activated.
Moodle relies on a timed procedure, know as the Moodle cron, to run many recurring tasks, such as sending notifications, forum posts, and messages, running reports such as ELIS reports and completion checking, and integration related batch processes such as LDAP synchronization. By default, Data Hub also uses the Moodle cron to process enrollment files. When these files exceed 40,000 lines of data, it may take too long to run, causing other operations to fail to run.

To address this issue for very large enrollment/user creation files, we implemented a separate system-level cron process to call the Data Hub processes by itself which will not impact the Moodle cron from running regularly.

If you need to run very large enrollment files, please open a support ticket to have the optional large file processing cron task setup for you - checking the box in the example above will not setup the DH cron for you, it will just disable the standard cron, meaning Data Hub will no longer run.

Remote-Learner support will have to configure your server to run the actual cron to process the Data Hub files. This also requires that your hosting level be at our Hosting Level 3, or above, or on our Red Hat Enterprise Virtual server system.

Data Hub block configuration screen
  1. Using DH Basic: This setting lets you switch between using Data Hub Basic and ELIS Data Hub. When this is selected, Data Hub Basic will work - when this is not selected, ELIS Data Hub will work.