Configure Update Options for Import

 

Allow Editing of Imported Cells and Mark Changed Cell Values

In the Configure Import Options pane, which you open using the green gear icon, the options described below may be relevant to your particular import.

Allow editing of imported cells

Allow editing of imported cells is not selected by default for new data imports, because generally speaking, it is unlikely that users want to edit imported data directly. Furthermore, if you edit imported data, it can be overwritten when the data import is updated. For existing (legacy) data import models, the "Allow editing" option is selected by default.

Per the hover text for this option, 'By default imported data is read-only. Select to allow modifications, which may be overwritten by a later update.'

If you choose Allow Editing of Imported Cells, Quantrix can also mark, or track edits made to the editable matrix cells.

By default, if you choose Allow Editing of Imported Cells, the option to Mark Changed Cell Values is selected. You can click to clear the selection from the check box.

Mark Changed Cell Values

Mark Changed Cell Values allows you to see a visual indication of the cells whose values you've changed, and optionally to Show Changed Rows, and/or Show Changed Columns.  Using the "Show Changed" options is an easy way to show only the rows or columns containing changes. Return to the full view of all rows/columns by clicking the option(s) again to remove the selection check mark.

When you edit cell values, the changed cell visually indicates the value has changed:

If you use Undo or you change the value back to the original value, the changed indicator is removed. If you Update the Data Import, a message may prompt you that updating may overwrite your changed cell values:  "Overwrite Data? The import has user changed cells that may be overwritten by the update".  

In certain scenarios you may not be prompted before the Update Data Import: if the import is using a history category the marked cell is left unchanged because the updated data is put in a new history item; an all rows category with the append data option appends the data, leaving original cell value unchanged.

Note that if you have changed cell values and you save or close and reopen the model, the changed cell values retain the changed indicator. You can turn off the Mark Changed Cell Values by opening the Configure Import Options panel and removing the option: the marked cell indicators are removed.
Note that changing the location "On Update Put Imported Data in" using the enabled edit pencil removes any previous changed values.

If you Allow editing of imported cells in Configure Import Options, a right-click option for Changed Cells is available from cells or items. The image below shows the Changed Cells right-click menu with 3 options because the import involved Salesforce. For other imports only the top two options are available (Show Changed Rows, Show Changed Columns): 

Put imported data in: Using the Edit pencil for Import Location

Import location choices affect updating categories that were created by dragging fields over as categories (i.e. they are non-Data Import categories).

The Edit pencil is not enabled for data imports to new matrices, and is disabled unless there is a non-data import category.

When you click the Edit pencil, the Import Location dialog opens so you can choose where to put the imported data:

 

The hover text for "On Update: Put imported data in" option says 'Choose where to put imported data. By default imported data will go into the first item of any category not controlled by this import configuration.

On Update Notes:

  • The "On Update, Put imported data in" option applies whether All Rows is in use or not, provided there is at least one user-created (i.e. non-data import) category.

  • To use the "On Update, Put imported data in" option, click the green Pencil icon (the Pencil icon is disabled unless there is a non-data import category in an existing, vs. new, matrix). An Import Location dialog displays showing eligible categories, with a drop-down arrow showing each eligible category that contains items.

  • Any category in a data import matrix that is not connected to the matrix's data source is eligible for the On Update > Import Location option. Using the On Update option is optional: if you don't use it to specify where the update data should go, it defaults to putting the data in the first item along every eligible category.

  • If you choose an a different item and it contains data, a warning appears and you are given the option to overwrite the data or cancel.

  • If you choose an item that is later deleted, the location is no longer valid. The matrix, model tab and the configure import button show a warning error, the `Put imported data in` field is outlined, and the missing item is underlined. Due to the warning error, an Update will fail.

Categories and Update Data Import

When a Data Import matrix is updated, all categories in the matrix that are related to the data source, as indicated by the data import icon on the category, are updated according to the order in the data source from which they get their items. Only categories associated with the same data source as the matrix are used to populate the data.

In other categories in the matrix, whether or not the category is a data import category, the data is placed in the first item of the category unless you use the On Update option to choose another location as described below.

Only data in the matrices targeted by the update is updated regardless of other matrices that may be linked by the categories in those matrices.

Note that any change to the Data Import configuration on a category removes any user data (i.e. removes any non-Data Import data).

About Location and Invalid Errors

When you have an error, Quantrix puts small error indicators in multiple places to alert you that there is a problem.  If you hover over them, a tooltip explains the nature of the error.

Matrix tabs, Model Browser matrices, the Configure Import Matrix icon, and the On Update, Put Imported Data in are examples of where error indicators show. The error indicator for the Put Imported Data in is underlined in red whereas the others are indicated with a red dot on the existing icon as shown below.

If you hover over the error icon in the Model Browser or the import configuration icon on the bottom right of the import matrix, hover text displays:

 

      

 

 

Live Preview or Update Button

Live Preview lets you see updates as you make changes. If you prefer to work with the import and see the update when you're ready, leave the check box blank next to Live Preview: an Update button appears that you can click whenever you want to see updates. For large data sets, we recommend that you not use the Live preview option when making changes (i.e., selecting or deselecting options) for import options.

Configure Import Options from Gear Icon

 

The Configure Import Options gear icon, , opens a panel in which you can choose options relating to updating data. Note that if you have not placed a category from the data tree onto the data matrix, the options don't show for When items and data no longer present, and they do not apply if you are using All Rows.

 

 
Add new item to a History category
Use History Category

Choose to have updated data added as a new item in a dedicated History category (only if All Rows is not in use)

You may want to record the history of your imported data rather than overwriting it. Provided All Rows is not in use, you can choose to have updated data added as a new item in a History category. If you select this option, a new History category is created, showing the data import icon, with a row of History items. You can rename the History category if desired.

 

  • The History category is linked to a data source. If the History category is in an import matrix using that data source, that History category becomes the history category for that matrix.
  • Live preview is automatically disabled when there is a History category.
  • When you initially finish configuration after choosing to use a History category to hold updated data, the History category creates and populates a new item to hold the history.  With each subsequent update a new history item is created and populated.
  • You can delete History items as desired.
  • If the History item needs updating, a message displays in the Modeler taskbar.
  • If a History category is shared by multiple import matrices, updating any one of them updates them all. Thus, the history item can be updated by any import matrix that shares it.

Notes:

If a History category is shared by multiple import matrices, and a sharing matrix lacks update permissions, upon update the item is created but is not populated with data.

When items and data no longer present

Notes: Missing Items refers to Data Import items that no longer exist in the data source.  The update behavior determines what happens to those items.  Choose how to handle items and cell data that no longer exist in the Update (that no longer exist in the data source) when All Rows is not in use (remove or keep the items and data that aren't in the update; remove the data that isn't in the update but keep the items)

You can set a default in Settings (Settings > Data > Data Import) and then change it for each data import.

The option is available and applies depending on whether you are using All Rows, and only if you've dragged a category from the data tree to the data matrix.

Hover over the question mark icons for tooltips and make your selections.

 

Note that if you keep Live Preview selected and you change your selection for When items and data are no longer present, a message may display for larger data sets informing you that the Update Behavior is changing.

Import Options, All Rows Details

All Rows Update

When All Rows is used, update choices are to:

Replace all the rows and data

Append the data in new row items along the All Rows category

All Rows Update Notes:

  • During an Update with Replace, the All Rows category replaces all the rows and data whenever updated.

  • When Live Preview is selected for Replace, updates occur automatically so the Update button doesn't appear.

  • During an Update with Append, the update brings in data as new rows in the All Rows category and the data from the update is put only in those corresponding rows.

  • During an Update with Append, the sequence of row numbers is dependent on the current items in the category.  For example if the first update brought in data in rows 1-10, the next update would start at 11. If you deleted rows 1-5, the update would start at 11, but if you removed 6-10, the next update would start at 6.  

  • Append starts at the last row of the All Rows category. If there is a summary item or items at the end of the category, the items are added before the summary items.  If the summary items are not at the end, the new items are added at the end.

  • The Live Preview option is disabled when Append is selected.

  • If you update right after the data import was created and Append is used, All Rows is replaced because it is the first user initiated update. Subsequent updates append the data.

  • Updating when the all rows category is linked with another matrix (with the same data source, and assuming update permissions are adequate), updates the linked all rows category and updates the data in the linked matrices.

Update Notes:

  • If the update contains new items, the options to "keep items" results in new items being added to the category. Existing items that refer to missing data (data that no longer exists in the data source) are not removed by the update.

  • If you are updating and items are grouped, if the update puts an item in a different group, the item in the original group remains.

  • If the update results in No Data and there are existing data items, the category does not change.

  • If the update results in Too Many Items to import, the category does not change but a warning appears indicating that the update resulted in too many rows.

  • If there is already an item in the category with "Too Many Items", and if the update contains new values or "No Data", the item is removed.  

  • If a single item is a "No Matches" item, it is replaced by the update if the update has values, or with Too Many values if there are too many. If there are too many values a warning message appears.

  • If the update results in items being removed, items and groups that refer to data that no longer exists in the data source are also removed.

  • If the items are grouped using a data import grouping, and the category configuration changes, the items are removed.

  • If you change the data location within `Put imported data in', each item in the History category retains the data in the location that was current for that update. You can move that data manually if desired, and new updates will go to the new location.

Database