ELIS 1.9 Manual

ELIS Data Hub

ELIS Data Hub General Settings

Data Hub is added to the site as a block. The general settings for Data Hub are located on the Data Hub block configuration screen. ELIS Data Hub is accessed through the Program Administration block > Admin > Data hub link.

In ELIS 1.8.7 there is a new setting that enables using Data Hub Basic with ELIS. It is the last setting available on the Data Hub block configuration screen. If your using DH Basic with ELIS, the DH block will need to be added to the home page of the site for access. Once the DH block has been added to the site, it will only be visible when DH Basic is enabled.

General Settings

The Data Hub block configuration settings, shown in the images below, are located in the Site Administration block > Modules > Blocks > Data Hub.

The file locations will be setup by Remote-Learner during the installation process. You will need to know these file locations to access them on your server. The DH folder locations can be accessed via SFTP or SCP from your source server. These folders can not be accessed with a web browser.

Data Hub Block Configuration:
Data Hub block configuration
  1. Import file location: This is where files will be placed to be processed by Data Hub. The files placed here will be automatically processed every 30 minutes by default. Files can also be processed immediately by selecting the Save and Process button on the User, Course, and Enrollment tabs. Selecting the Import all button on the General tab will import all three files at once.
  2. Export file location: Export files are processed every 24 hours by default, this time can be changed by the "Export period" setting, see #8 below. Export files can be processed immediately by selecting the 'Export now' button on the General tab. If you don't want to have DH export any files, leave the Export file location field empty.
  3. Log file location: Location of all import and export log files - every time the batch file runs, a log will be written, describing in detail what actions were taken by the import script.
  4. Email notification: Enter the id numbers of users that should be emailed the log files. The system will then email log files to the email associated with the id number. Note that a user's id number must be the same as their username for the notifications to work. This will be fixed in Data Hub 2.0.
Data Hub block configuration screen
  1. Import period: Set the import frequency. An example of the time format is 3d, 4h, 50m. This would import files every 3 days, 4 hours , and 50 minutes.
  2. Create groups and groupings: Automatically create new groups in Moodle courses.
  3. Import date format: The are 3 import date formats, whichever format is selected here must be used in the import files.
    • M/D/Y - MM/DD/YY
    • D-M-Y - DD-MM-YY
    • Y.M.D. - YY.MM.DD
Data Hub block configuration screen
  1. Export period: Set the export frequency. An example of the time format is 3d, 4h, 50m. This would create an export file every 3 days, 4 hours , and 50 minutes.
  2. Unique export file names: This gives each export file a unique time stamp. If this is selected then each export will have a separate file name. If this isn't selected then the previous export file will be replaced when a new export file is processed.
  3. Include all historical data: If this is selected all the completion data for the site is included in the export report each time it is run. If this isn't selected, then only completion data since the last report is included.
  4. Disable cron: This will turn off the standard cron process for Data Hub - this will stop DH from processing files, so please makes sure Remote-Learner support confirms that the DH Cron is operational before this is activated.
Moodle relies on a timed procedure, know as the Moodle cron, to run many recurring tasks, such as sending notifications, forum posts, and messages, running reports such as ELIS reports and completion checking, and integration related batch processes such as LDAP synchronization. By default, Data Hub also uses the Moodle cron to process enrollment files. When these files exceed 40,000 lines of data, it may take too long to run, causing other operations to fail to run.

To address this issue for very large enrollment/user creation files, we implemented a separate system-level cron process to call the Data Hub processes by itself which will not impact the Moodle cron from running regularly.

If you need to run very large enrollment files, please open a support ticket to have the optional large file processing cron task setup for you - checking the box in the example above will not setup the DH cron for you, it will just disable the standard cron, meaning Data Hub will no longer run.

Remote-Learner support will have to configure your server to run the actual cron to process the Data Hub files. This also requires that your hosting level be at our Hosting Level 3, or above, or on our Red Hat Enterprise Virtual server system.

Data Hub block configuration screen
  1. Using DH Basic: This setting lets you switch between using Data Hub Basic and ELIS Data Hub. DH Basic is different than ELIS DH, refer to the DH Basic for ELIS documentation if using DH Basic with ELIS. It is located below the ELIS DH documentation in this book. The first difference you'll need to be aware of is DH Basic is accessed through the Data Hub block, while ELIS DH is accessed through the Program Administration block > Admin > Data Hub.