llua_jira_status_star-dist Normal 0 / ID_BATCH Y ID_BATCH CHANNEL_ID Y CHANNEL_ID TRANSNAME Y TRANSNAME STATUS Y STATUS LINES_READ Y LINES_READ LINES_WRITTEN Y LINES_WRITTEN LINES_UPDATED Y LINES_UPDATED LINES_INPUT Y LINES_INPUT LINES_OUTPUT Y LINES_OUTPUT LINES_REJECTED Y LINES_REJECTED ERRORS Y ERRORS STARTDATE Y STARTDATE ENDDATE Y ENDDATE LOGDATE Y LOGDATE DEPDATE Y DEPDATE REPLAYDATE Y REPLAYDATE LOG_FIELD Y LOG_FIELD EXECUTING_SERVER N EXECUTING_SERVER EXECUTING_USER N EXECUTING_USER CLIENT N CLIENT
ID_BATCH Y ID_BATCH SEQ_NR Y SEQ_NR LOGDATE Y LOGDATE TRANSNAME Y TRANSNAME STEPNAME Y STEPNAME STEP_COPY Y STEP_COPY LINES_READ Y LINES_READ LINES_WRITTEN Y LINES_WRITTEN LINES_UPDATED Y LINES_UPDATED LINES_INPUT Y LINES_INPUT LINES_OUTPUT Y LINES_OUTPUT LINES_REJECTED Y LINES_REJECTED ERRORS Y ERRORS INPUT_BUFFER_ROWS Y INPUT_BUFFER_ROWS OUTPUT_BUFFER_ROWS Y OUTPUT_BUFFER_ROWS
ID_BATCH Y ID_BATCH CHANNEL_ID Y CHANNEL_ID LOG_DATE Y LOG_DATE LOGGING_OBJECT_TYPE Y LOGGING_OBJECT_TYPE OBJECT_NAME Y OBJECT_NAME OBJECT_COPY Y OBJECT_COPY REPOSITORY_DIRECTORY Y REPOSITORY_DIRECTORY FILENAME Y FILENAME OBJECT_ID Y OBJECT_ID OBJECT_REVISION Y OBJECT_REVISION PARENT_CHANNEL_ID Y PARENT_CHANNEL_ID ROOT_CHANNEL_ID Y ROOT_CHANNEL_ID
ID_BATCH Y ID_BATCH CHANNEL_ID Y CHANNEL_ID LOG_DATE Y LOG_DATE TRANSNAME Y TRANSNAME STEPNAME Y STEPNAME STEP_COPY Y STEP_COPY LINES_READ Y LINES_READ LINES_WRITTEN Y LINES_WRITTEN LINES_UPDATED Y LINES_UPDATED LINES_INPUT Y LINES_INPUT LINES_OUTPUT Y LINES_OUTPUT LINES_REJECTED Y LINES_REJECTED ERRORS Y ERRORS LOG_FIELD N LOG_FIELD
ID_BATCH Y ID_BATCH CHANNEL_ID Y CHANNEL_ID LOG_DATE Y LOG_DATE METRICS_DATE Y METRICS_DATE METRICS_CODE Y METRICS_CODE METRICS_DESCRIPTION Y METRICS_DESCRIPTION METRICS_SUBJECT Y METRICS_SUBJECT METRICS_TYPE Y METRICS_TYPE METRICS_VALUE Y METRICS_VALUE
0.0 0.0 100000 50 50 N Y 50000 Y N 1000 100 cluster N dynamic Y 1 ati-dev-ana01 ati-dev-ana01 9081 pentaho-di njain Encrypted 2be98afc86aa7f2e4bb18bd63c99dbdde Y N ATI-PRD-ANA03 ATI-PRD-ANA03 9080 pentaho-di admin Encrypted 2be98afc86aa7f2e4bb18bd63c99dbdde N N ATI-STG-ANA03 ATI-STG-ANA03 9080 pentaho-di pentaho Encrypted 2be98afc86aa7f2b4ae17ba71d69dff8b N N DI Server localhost 9080 pentaho-di joe Encrypted 2be98afc86aa7f2e4bb18bd63c99dbdde Y N DI Server 5.0 localhost 9080 pentaho-di admin Encrypted 2be98afc86aa7f2e4bb18bd63c99dbdde Y N local 127.0.0.1 9080 cluster Encrypted 2be98afc86aa7f2e4cb1aa265cd86aac8 Y N Master localhost 8081 cluster Encrypted 2be98afc86aa7f2e4cb1aa265cd86aac8 Y N remote 192.168.1.16 9080 pentaho-di/kettle admin Encrypted 2be98afc86aa7f2e4bb18bd63c99dbdde Y N Slave1 localhost 8082 cluster Encrypted 2be98afc86aa7f2e4cb1aa265cd86aac8 N N Slave2 localhost 8083 cluster Encrypted 2be98afc86aa7f2e4cb1aa265cd86aac8 N N Slave3 localhost 8084 cluster Encrypted 2be98afc86aa7f2e4cb1aa265cd86aac8 N N Slave4 localhost 8085 cluster Encrypted 2be98afc86aa7f2e4cb1aa265cd86aac8 N N Slave5 localhost 8086 cluster Encrypted 2be98afc86aa7f2e4cb1aa265cd86aac8 N N ClusterSchema 40000 2000 5000 Y N Slave3 Slave2 Slave1 Master ClusterSchema_dynamic 40000 2000 5000 Y Y Master - 2020/08/06 18:24:35.729 schmitz 2022/06/03 16:13:43.354 H4sIAAAAAAAAAAMAAAAAAAAAAAA= N created (from jiraissue) 1920 1088 151 26 .SF NS Text 13 N N 0 0 0 255 205 112 100 100 100 Y created (from changegroup) 1248 1088 182 26 .SF NS Text 13 N N 0 0 0 255 205 112 100 100 100 Y Extract and Transform 32 64 145 26 .AppleSystemUIFont 13 N N 0 0 0 255 205 112 100 100 100 Y Load 32 1744 40 26 .AppleSystemUIFont 13 N N 0 0 0 255 205 112 100 100 100 Y If the status of an issue has never been changed, there is no status change event for that issue. The procedure on the right adds a change event to any issue that does not yet have a status change event. For the value of the status change event the current status of the issue is used, which should be the initial status, defined by the configured status workflow. For the timestamp of the change event, the creation timestamp of the issue itself is used. 832 960 656 106 .AppleSystemUIFont 13 N N 0 0 0 255 205 112 100 100 100 Y Data Warehouse [ihre_domain/container_name] POSTGRESQL Native datawarehouse [host/container_port] datawarehouse Encrypted 6461746175dfeacaa005d28181bb18bd63c99dbdde FORCE_IDENTIFIERS_TO_LOWERCASE N FORCE_IDENTIFIERS_TO_UPPERCASE N IS_CLUSTERED N PORT_NUMBER [host/container_port] PRESERVE_RESERVED_WORD_CASE Y QUOTE_ALL_FIELDS N SUPPORTS_BOOLEAN_DATA_TYPE N SUPPORTS_TIMESTAMP_DATA_TYPE N USE_POOLING N Jira DB [ihre_domain/container_name] POSTGRESQL Native jira [host/container_port] jira Encrypted 2be98c5a118c69686bb18bd63c99dbdde FORCE_IDENTIFIERS_TO_LOWERCASE N FORCE_IDENTIFIERS_TO_UPPERCASE N IS_CLUSTERED N PORT_NUMBER [host/container_port] PRESERVE_RESERVED_WORD_CASE Y QUOTE_ALL_FIELDS N SUPPORTS_BOOLEAN_DATA_TYPE Y SUPPORTS_TIMESTAMP_DATA_TYPE Y USE_POOLING N Data Grid Transformation Executor - llua_jira_issue_dimension-dist Y Transformation Executor - llua_jira_issue_dimension-dist jiraisssue Y jiraisssue Sort rows id 3 Y Calculator split timestamp Select values remove created field Y Select values remove created field Main table Y author dimension issue dimension Y issue dimension Remove lookup fields Y Remove lookup fields date dimension Y date dimension time dimension Y time dimension rename dimension ids Y Main table author dimension Y rename dimension ids Blocking step Y Blocking step Insert / update Y Filter rows for status field Select values: rename id to changeitem and remove field Y Merge join newvalue Sort rows oldvalue Y Merge join oldvalue Select values: rename status and remove obsolete fields Y Select values: rename id to changeitem and remove field Sort rows newvalue Y Select values: rename status and remove obsolete fields Sort rows groupid Y Sort rows newvalue Merge join newvalue Y Sort rows id Merge join newvalue Y Sort rows id Merge join oldvalue Y Sort rows oldvalue Merge join oldvalue Y Table input - changeitem Filter rows for status field Y Table input - status Sort rows id Y Merge join groupid Select values only necessary values Y Select values only necessary values Sort rows issueid Y Sort rows id 2 Merge join groupid Y Table input - changegroup Sort rows id 2 Y Sort rows groupid Merge join groupid Y Merge join issueid Select values - rm id and status_old Y Sort rows issueid Merge join issueid Y Sort rows id 3 Merge join issueid Y Append streams 4 Calculator split timestamp Y Select values - rm id and status_old Select values - sort columns Y Select values - sort columns Append streams 4 Y Concat fields - date & time Text file output: CSV for PM Y Main table Concat fields - date & time Y Append streams 2 Add a checksum - changeitem_manual Y Filter rows - created == created_min Sort rows issueid 2 Y Filter rows - status_old == null Select values 2 Y Filter rows - status_old == null Select values sort and rename Y Group by - issueid, aggregate created_min Filter rows - created == created_min Y Merge join id - issueid Filter rows - created <> created_min Y Select values sort and rename 2 Append streams 2 Y Select values 2 Stream lookup - issue data Y Select values sort and rename Set field value to a constant - changeitem Y Set field value to a constant - changeitem Append streams 2 Y Sort rows - issueid Group by - issueid, aggregate created_min Y Sort rows issueid 2 Merge join id - issueid Y Sort rows 9 Merge join id - issueid Y Stream lookup - issue data Stream lookup - status Y Stream lookup - status Select values sort and rename 2 Y Table input - pseudo_jiraissue Sort rows 9 Y Table input - status 2 Stream lookup - status Y Filter rows - created <> created_min Filter rows - status_old == null Y Add a checksum - changeitem_manual Set field value changeitem Y Set field value changeitem Select values remove changeitem_manual Y Merge join issueid Sort rows - issueid Y Select values remove changeitem_manual Append streams 4 Y Sort rows id 3 jiraissue 2 Y jiraissue 2 Stream lookup - issue data Y Add a checksum - changeitem_manual CheckSum Y 1 none CRC32 changeitem_manual string N N author issueid created 1312 1376 Y Append streams 2 Append N 1 none Set field value to a constant - changeitem Select values sort and rename 2 1504 1376 Y Append streams 4 Append N 1 none Select values remove changeitem_manual Select values - sort columns 688 1376 Y Blocking step BlockingStep Y 1 none Y %%java.io.tmpdir%% block 5000 Y 688 2704 Y Calculator split timestamp Calculator Y 1 none Y year YEAR_OF_DATE created None -1 -1 N month MONTH_OF_DATE created None -1 -1 N day DAY_OF_MONTH created None -1 -1 N hour HOUR_OF_DAY created None -1 -1 N minute MINUTE_OF_HOUR created None -1 -1 N second SECOND_OF_MINUTE created None -1 -1 N 688 1504 Y Concat fields - date & time ConcatFields Y 1 none - " N N
N
N
DOS None N Y N Y txt N N N N N N Y N N 0 year None none -1 -1 month None none -1 -1 day None none -1 -1 hour None none -1 -1 minute None none -1 -1 second None none -1 -1 timestamp 255 N 864 1888 Y Data Grid DataGrid Y 1 none 160 928 Y Filter rows - created <> created_min FilterRows Y 1 none Filter rows - status_old == null N created_min <> created 2016 1136 Y Filter rows - created == created_min FilterRows Y 1 none Sort rows issueid 2 N created = created_min 1328 1136 Y Filter rows - status_old == null FilterRows Y 1 none Select values 2 Select values sort and rename N status_old IS NULL 2288 1136 Y Filter rows for status field FilterRows Y 1 none Select values: rename id to changeitem and remove field N field = constant String status -1 -1 N 352 128 Y Group by - issueid, aggregate created_min GroupBy Y 1 none Y N %%java.io.tmpdir%% grp N N issueid created_min created MIN 1056 1136 Y Insert / update InsertUpdate Y 1 none Data Warehouse 100 N llua_jira_status
fact_status
changeitem changeitem = status status Y author_id author_id Y issue_id issue_id Y date_id date_id Y time_id time_id Y changeitem changeitem N 688 2816 Y Main table Dummy N 1 none 688 1888 Y Merge join id - issueid MergeJoin N 1 none LEFT OUTER Sort rows 9 Sort rows issueid 2 id issueid 1808 1136 Y Merge join groupid MergeJoin Y 1 none LEFT OUTER Sort rows groupid Sort rows id 2 groupid id 688 816 Y Merge join issueid MergeJoin N 1 none LEFT OUTER Sort rows issueid Sort rows id 3 issueid id 688 1136 Y Merge join newvalue MergeJoin Y 1 none LEFT OUTER Sort rows newvalue Sort rows id newvalue id 688 288 Y Merge join oldvalue MergeJoin Y 1 none LEFT OUTER Sort rows oldvalue Sort rows id oldvalue id 688 480 Y Remove lookup fields SelectValues Y 1 none N issueid assignee summary label project issuetype epic sprint creator reporter 688 2224 Y Select values - rm id and status_old SelectValues N 1 none N status_old id 688 1216 Y Select values - sort columns SelectValues Y 1 none status issueid author created changeitem assignee creator reporter summary label project issuetype epic sprint N 688 1296 Y Select values 2 SelectValues Y 1 none issuestatus status id creator author created changeitem N 2288 1264 Y Select values remove changeitem_manual SelectValues Y 1 none N changeitem_manual 848 1376 Y Select values only necessary values SelectValues N 1 none status issueid author created changeitem status_old N 688 912 Y Select values remove created field SelectValues Y 1 none N created 688 1632 Y Select values sort and rename SelectValues Y 1 none status_old status id issueid creator author created changeitem assignee creator reporter summary label project issuetype epic sprint N 2032 1264 Y Select values sort and rename 2 SelectValues Y 1 none status_name status id issueid author created changeitem assignee creator reporter summary label project issuetype epic sprint N 1712 1376 Y Select values: rename id to changeitem and remove field SelectValues Y 1 none id changeitem Y field 688 128 Y Select values: rename status and remove obsolete fields SelectValues Y 1 none pname status pname_1 status_old Y newvalue id oldvalue id_1 688 608 Y Set field value changeitem SetValueField Y 1 none changeitem changeitem_manual 1088 1376 Y Set field value to a constant - changeitem SetValueConstant N 1 none N changeitem Y 1696 1264 Y Sort rows - issueid SortRows Y 1 none %%java.io.tmpdir%% out 1000000 N N issueid Y N N 0 N created Y N N 0 N 848 1136 Y Sort rows issueid 2 SortRows Y 1 none %%java.io.tmpdir%% out 1000000 N N issueid Y N N 0 N 1568 1136 Y Sort rows 9 SortRows Y 1 none %%java.io.tmpdir%% out 1000000 N N id Y N N 0 N 1760 1056 Y Sort rows groupid SortRows Y 1 none %%java.io.tmpdir%% out 1000000 N N groupid Y N N 0 N 688 704 Y Sort rows id SortRows N 1 none %%java.io.tmpdir%% out 1000000 N N id Y N N 0 N 352 288 Y Sort rows id 2 SortRows Y 1 none %%java.io.tmpdir%% out 1000000 N N id Y N N 0 N 352 816 Y Sort rows id 3 SortRows N 1 none %%java.io.tmpdir%% out 1000000 N N id Y N N 0 N 352 1136 Y Sort rows issueid SortRows N 1 none %%java.io.tmpdir%% out 1000000 N N issueid Y N N 0 N 688 1024 Y Sort rows newvalue SortRows Y 1 none %%java.io.tmpdir%% out 1000000 N N newvalue Y N N 0 N 688 208 Y Sort rows oldvalue SortRows Y 1 none %%java.io.tmpdir%% out 1000000 N N oldvalue Y N N 0 N 688 384 Y Stream lookup - issue data StreamLookup Y 1 none jiraissue 2 N Y N N id id assignee assignee String summary summary String label label String project project String issuetype issuetype String epic epic String sprint sprint String creator creator String reporter reporter String 2288 1440 Y Stream lookup - status StreamLookup Y 1 none Table input - status 2 N Y N N status id pname status_name None 2032 1376 Y Table input - changegroup TableInput Y 1 none Jira DB SELECT id , issueid , author , created FROM public.changegroup 0 N N N N Integer normal id 18 0 Table input - changegroup id ####0;-####0 . , none N Y 0 N N N en_US Europe/Berlin N Integer normal issueid 18 0 Table input - changegroup issueid ####0;-####0 . , none N Y 0 N N N en_US Europe/Berlin N String normal author 255 -1 Table input - changegroup author . , none N Y 0 N N N en_US Europe/Berlin N Timestamp normal created 6 -1 Table input - changegroup created . , none N Y 0 N N N en_US Europe/Berlin N 160 816 Y Table input - changeitem TableInput Y 1 none Jira DB SELECT id , groupid , field , newvalue , oldvalue FROM public.changeitem 0 N N N N Integer normal id 18 0 Table input - changeitem id ####0;-####0 . , none N Y 0 N N N en_US Europe/Berlin N Integer normal groupid 18 0 Table input - changeitem groupid ####0;-####0 . , none N Y 0 N N N en_US Europe/Berlin N String normal field 255 -1 Table input - changeitem field . , none N Y 0 N N N en_US Europe/Berlin N String normal newvalue 2147483647 -1 Table input - changeitem newvalue . , none N Y 0 N N N en_US Europe/Berlin N String normal oldvalue 2147483647 -1 Table input - changeitem oldvalue . , none N Y 0 N N N en_US Europe/Berlin N 160 128 Y Table input - pseudo_jiraissue TableInput Y 1 none Jira DB SELECT id , issuestatus , created , creator FROM public.jiraissue 0 N N N N Integer normal id 18 0 Table input - pseudo_jiraissue id ####0;-####0 . , none N Y 0 N N N en_US Europe/Berlin N String normal issuestatus 255 -1 Table input - pseudo_jiraissue issuestatus . , none N Y 0 N N N en_US Europe/Berlin N Timestamp normal created 6 -1 Table input - pseudo_jiraissue created . , none N Y 0 N N N en_US Europe/Berlin N String normal creator 255 -1 Table input - pseudo_jiraissue creator . , none N Y 0 N N N en_US Europe/Berlin N 1760 960 Y Table input - status TableInput Y 1 none Jira DB SELECT id , pname FROM public.issuestatus 0 N N N N String normal id 60 -1 Table input - status id . , none N Y 0 N N N en_US Europe/Berlin N String normal pname 60 -1 Table input - status pname . , none N Y 0 N N N en_US Europe/Berlin N 160 288 Y Table input - status 2 TableInput Y 1 none Jira DB SELECT id , pname FROM public.issuestatus 0 N N N N String normal id 60 -1 Table input - status 2 id . , none N Y 0 N N N en_US Europe/Berlin N String normal pname 60 -1 Table input - status 2 pname . , none N Y 0 N N N en_US Europe/Berlin N 2032 1504 Y Text file output: CSV for PM TextFileOutput Y 1 none ; " N N
Y
N
UNIX None UTF-8 N Y ${DI_HOME}/csv/jira_status_star N Y csv N N N N N Y -yyyy-MM-dd-HH-mm-ss Y N N 1072 1888 Y Transformation Executor - llua_jira_issue_dimension-dist TransExecutor Y 1 none filename ${Internal.Entry.Current.Directory}/llua_jira_issue_dimension-dist.ktr 0 Y Transformation Executor - llua_jira_issue_dimension-dist ExecutionTime ExecutionResult ExecutionNrErrors ExecutionLinesRead ExecutionLinesWritten ExecutionLinesInput ExecutionLinesOutput ExecutionLinesRejected ExecutionLinesUpdated ExecutionLinesDeleted ExecutionFilesRetrieved ExecutionExitStatus ExecutionLogText ExecutionLogChannelId jiraisssue id Integer 18 0 assignee String 255 -1 creator String 255 -1 reporter String 255 -1 summary String 255 -1 label String -1 -1 project String 255 -1 issuetype String 60 -1 epic String 255 -1 sprint String 255 -1 Transformation Executor - llua_jira_issue_dimension-dist FileName 160 1024 Y author dimension CombinationLookup Y 1 none llua_jira_status dim_author
Data Warehouse 100 9999 Y N N hashcode author author id tablemax N 688 2000 Y date dimension CombinationLookup Y 1 none llua_jira_status dim_date
Data Warehouse 100 9999 Y N N hashcode year year month month day day id tablemax N 688 2336 Y issue dimension DimensionLookup Y 1 none llua_jira_status dim_issue
Data Warehouse 100 Y issueid issue date_from date_to summary summary Update assignee assignee Insert creator creator Update reporter reporter Insert project project Update issuetype issuetype Update label labels Update epic epic Update sprint sprint Insert id tablemax N version 1900 2199 5000 N N none N 688 2128 Y jiraisssue Dummy Y 1 none 160 1136 Y jiraissue 2 Dummy Y 1 none 352 1440 Y rename dimension ids SelectValues Y 1 none status id author_id id_1 issue_id id_2 date_id id_3 time_id changeitem N 688 2592 Y time dimension CombinationLookup Y 1 none llua_jira_status dim_time
Data Warehouse 100 9999 Y N N hashcode hour hour minute minute second second id tablemax N 688 2464 Y N