Votre modèle de données pour la gestion des stocks

The Data Management Framework uses entity configuration, not a single script. The following specifies which entities, fields, and conditions are needed to generate the required activities during the post-export transformation step.

**1. Activity: Goods Receipt Recorded**
*   **Source Entity**: `VendPackingSlipTrans` (Purchase Order Receipt Lines)
*   **Logic**: Each row represents a receipt.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Goods Receipt Recorded'` -> `ActivityName`
    *   `CREATEDDATETIME` -> `EventTime`
    *   `CREATEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `INVENTDIMID` (lookup warehouse) -> `WarehouseId`
    *   `QTY` -> `Quantity`

**2. Activity: Quality Order Created**
*   **Source Entity**: `QualityOrders`
*   **Logic**: Each row represents a quality order creation.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Quality Order Created'` -> `ActivityName`
    *   `CREATEDDATETIME` -> `EventTime`
    *   `CREATEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `INVENTLOCATIONID` -> `WarehouseId`
    *   `QTY` -> `Quantity`

**3. Activity: Quality Inspection Performed**
*   **Source Entity**: `QualityOrders`
*   **Logic**: Filter for rows where `STATUS` is 'Pass' or 'Fail'.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Quality Inspection Performed'` -> `ActivityName`
    *   `MODIFIEDDATETIME` -> `EventTime`
    *   `MODIFIEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `INVENTLOCATIONID` -> `WarehouseId`
    *   `QTY` -> `Quantity`

**4. Activity: Put-away Work Created**
*   **Source Entity**: `WHSWorkTable`
*   **Logic**: Filter for rows where `WORKTYPE` is 'Put'.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Put-away Work Created'` -> `ActivityName`
    *   `CREATEDDATETIME` -> `EventTime`
    *   `USERID` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `WAREHOUSEID` -> `WarehouseId`
    *   `QTY` -> `Quantity`

**5. Activity: Put-away Completed**
*   **Source Entity**: `WHSWorkTable`
*   **Logic**: Filter for rows where `WORKTYPE` is 'Put' and `WORKSTATUS` is 'Closed'.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Put-away Completed'` -> `ActivityName`
    *   `MODIFIEDDATETIME` -> `EventTime`
    *   `MODIFIEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `WAREHOUSEID` -> `WarehouseId`
    *   `QTY` -> `Quantity`

**6. Activity: Stock Moved Internally**
*   **Source Entity**: `InventJournalTrans_Movement`
*   **Logic**: Rows from an inventory movement journal.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Stock Moved Internally'` -> `ActivityName`
    *   `TRANSDATE` -> `EventTime`
    *   `CREATEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `INVENTLOCATIONID` -> `WarehouseId`
    *   `QTY` -> `Quantity`

**7. Activity: Counting Journal Created**
*   **Source Entity**: `InventJournalTrans_Counting`
*   **Logic**: The creation of the journal line.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Counting Journal Created'` -> `ActivityName`
    *   `CREATEDDATETIME` -> `EventTime`
    *   `CREATEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `INVENTLOCATIONID` -> `WarehouseId`
    *   `COUNTED` -> `Quantity`

**8. Activity: Inventory Count Performed**
*   **Source Entity**: `InventJournalTrans_Counting`
*   **Logic**: The update of the journal line after counting.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Inventory Count Performed'` -> `ActivityName`
    *   `MODIFIEDDATETIME` -> `EventTime`
    *   `MODIFIEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `INVENTLOCATIONID` -> `WarehouseId`
    *   `COUNTED` -> `Quantity`

**9. Activity: Inventory Discrepancy Adjusted**
*   **Source Entity**: `InventJournalTrans_Counting`
*   **Logic**: The posting of the journal, which creates the inventory transaction.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Inventory Discrepancy Adjusted'` -> `ActivityName`
    *   `TRANSDATE` -> `EventTime`
    *   `CREATEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `INVENTLOCATIONID` -> `WarehouseId`
    *   `QTY` -> `Quantity`

**10. Activity: Picking Work Created**
*   **Source Entity**: `WHSWorkTable`
*   **Logic**: Filter where `WORKTYPE` is 'Pick'.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Picking Work Created'` -> `ActivityName`
    *   `CREATEDDATETIME` -> `EventTime`
    *   `USERID` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `WAREHOUSEID` -> `WarehouseId`
    *   `QTY` -> `Quantity`

**11. Activity: Picking Completed**
*   **Source Entity**: `WHSWorkTable`
*   **Logic**: Filter where `WORKTYPE` is 'Pick' and `WORKSTATUS` is 'Closed'.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Picking Completed'` -> `ActivityName`
    *   `MODIFIEDDATETIME` -> `EventTime`
    *   `MODIFIEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `WAREHOUSEID` -> `WarehouseId`
    *   `QTY` -> `Quantity`

**12. Activity: Packing Completed**
*   **Source Entity**: `SalesPackingSlipTrans`
*   **Logic**: Assume packing is complete when the packing slip is posted.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Packing Completed'` -> `ActivityName`
    *   `CREATEDDATETIME` (approximates packing time) -> `EventTime`
    *   `CREATEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `INVENTDIMID` (lookup warehouse) -> `WarehouseId`
    *   `QTY` -> `Quantity`

**13. Activity: Goods Issue Recorded**
*   **Source Entity**: `SalesPackingSlipTrans`
*   **Logic**: The posting of a packing slip represents the goods issue.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Goods Issue Recorded'` -> `ActivityName`
    *   `CREATEDDATETIME` -> `EventTime`
    *   `CREATEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `INVENTDIMID` (lookup warehouse) -> `WarehouseId`
    *   `QTY` * -1 -> `Quantity`

**14. Activity: Return Goods Received**
*   **Source Entity**: `InventTrans`
*   **Logic**: Filter `InventTrans` for transactions linked to a return order (`TRANTYPE` = 'Sales').
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Return Goods Received'` -> `ActivityName`
    *   `DATEPHYSICAL` -> `EventTime`
    *   `CREATEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `INVENTDIMID` (lookup warehouse) -> `WarehouseId`
    *   `QTY` -> `Quantity`

**15. Activity: Stock Scrapped**
*   **Source Entity**: `InventJournalTrans_Movement`
*   **Logic**: Filter for journal lines where a specific scrap reason code is used.
*   **Field Mapping**:
    *   `INVENTBATCHID` -> `InventoryBatchLot`
    *   `'Stock Scrapped'` -> `ActivityName`
    *   `TRANSDATE` -> `EventTime`
    *   `CREATEDBY` -> `UserId`
    *   `ITEMID` -> `ItemId`
    *   `INVENTLOCATIONID` -> `WarehouseId`
    *   `QTY` -> `Quantity`
    *   `REASONREFRECID` (lookup reason code) -> `ReasonCode`

DECLARE @StartDate DATETIME = '2023-01-01';
DECLARE @EndDate DATETIME = '2023-12-31';
DECLARE @DataAreaId NVARCHAR(4) = '[YourCompanyCode]'; -- E.g., 'USMF'

SELECT
    CAST(T.InventoryBatchLot AS NVARCHAR(255)) AS InventoryBatchLot,
    CAST(T.ActivityName AS NVARCHAR(255)) AS ActivityName,
    T.EventTime,
    CAST(T.SourceSystem AS NVARCHAR(255)) AS SourceSystem,
    GETUTCDATE() AS LastDataUpdate,
    T.EventEndTime,
    CAST(T.UserId AS NVARCHAR(255)) AS UserId,
    CAST(T.ItemId AS NVARCHAR(255)) AS ItemId,
    CAST(T.WarehouseId AS NVARCHAR(255)) AS WarehouseId,
    CAST(T.ReasonCode AS NVARCHAR(255)) AS ReasonCode,
    T.Quantity
FROM (
    -- 1. Goods Receipt Recorded (Purchase or Production)
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Goods Receipt Recorded' AS ActivityName,
        it.DATEPHYSICAL AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        it.CREATEDBY AS UserId,
        it.ITEMID AS ItemId,
        id.INVENTLOCATIONID AS WarehouseId,
        NULL AS ReasonCode,
        it.QTY AS Quantity
    FROM InventTrans it
    JOIN InventDim id ON it.INVENTDIMID = id.INVENTDIMID AND it.DATAAREAID = id.DATAAREAID
    WHERE it.DATAAREAID = @DataAreaId AND it.DATEPHYSICAL BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND it.STATUSRECEIPT = 2 AND it.QTY > 0
      AND (it.TRANSTYPE = 0 OR it.TRANSTYPE = 2) -- Purchase order or Production

    UNION ALL

    -- 2. Quality Order Created
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Quality Order Created' AS ActivityName,
        iqo.CREATEDDATETIME AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        iqo.CREATEDBY AS UserId,
        iqo.ITEMID AS ItemId,
        id.INVENTLOCATIONID AS WarehouseId,
        NULL AS ReasonCode,
        iqo.QTY AS Quantity
    FROM InventQualityOrderTable iqo
    JOIN InventDim id ON iqo.INVENTDIMID = id.INVENTDIMID AND iqo.DATAAREAID = id.DATAAREAID
    WHERE iqo.DATAAREAID = @DataAreaId AND iqo.CREATEDDATETIME BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> ''

    UNION ALL

    -- 3. Quality Inspection Performed
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Quality Inspection Performed' AS ActivityName,
        iqo.MODIFIEDDATETIME AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        iqo.MODIFIEDBY AS UserId,
        iqo.ITEMID AS ItemId,
        id.INVENTLOCATIONID AS WarehouseId,
        CAST(iqo.STATUS AS NVARCHAR(255)) AS ReasonCode, -- Using status (Pass/Fail) as a reason
        iqo.QTY AS Quantity
    FROM InventQualityOrderTable iqo
    JOIN InventDim id ON iqo.INVENTDIMID = id.INVENTDIMID AND iqo.DATAAREAID = id.DATAAREAID
    WHERE iqo.DATAAREAID = @DataAreaId AND iqo.MODIFIEDDATETIME BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND iqo.STATUS IN (2, 3) -- Pass, Fail

    UNION ALL

    -- 4. Put-away Work Created
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Put-away Work Created' AS ActivityName,
        whs.CREATEDDATETIME AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        whs.CREATEDBY AS UserId,
        whs.ITEMID AS ItemId,
        whs.WAREHOUSEID AS WarehouseId,
        NULL AS ReasonCode,
        whs.QTY AS Quantity
    FROM WHSWorkTable whs
    JOIN InventDim id ON whs.INVENTDIMID = id.INVENTDIMID AND whs.DATAAREAID = id.DATAAREAID
    WHERE whs.DATAAREAID = @DataAreaId AND whs.CREATEDDATETIME BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND whs.WORKTYPE = 0 -- Put

    UNION ALL

    -- 5. Put-away Completed
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Put-away Completed' AS ActivityName,
        whs.CLOSEDTIMESTAMP AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        whs.MODIFIEDBY AS UserId,
        whs.ITEMID AS ItemId,
        whs.WAREHOUSEID AS WarehouseId,
        NULL AS ReasonCode,
        whs.QTY AS Quantity
    FROM WHSWorkTable whs
    JOIN InventDim id ON whs.INVENTDIMID = id.INVENTDIMID AND whs.DATAAREAID = id.DATAAREAID
    WHERE whs.DATAAREAID = @DataAreaId AND whs.CLOSEDTIMESTAMP BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND whs.WORKTYPE = 0 AND whs.WORKSTATUS = 4 -- Put, Closed

    UNION ALL

    -- 6. Stock Moved Internally
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Stock Moved Internally' AS ActivityName,
        ijt.POSTEDDATETIME AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        ijt.CREATEDBY AS UserId,
        ijt.ITEMID AS ItemId,
        id.INVENTLOCATIONID AS WarehouseId,
        NULL AS ReasonCode,
        ijt.QTY AS Quantity
    FROM InventJournalTrans ijt
    JOIN InventJournalTable ijtbl ON ijt.JOURNALID = ijtbl.JOURNALID AND ijt.DATAAREAID = ijtbl.DATAAREAID
    JOIN InventDim id ON ijt.INVENTDIMID = id.INVENTDIMID AND ijt.DATAAREAID = id.DATAAREAID
    WHERE ijt.DATAAREAID = @DataAreaId AND ijt.POSTEDDATETIME BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND ijtbl.JOURNALTYPE = 3 -- Transfer

    UNION ALL

    -- 7. Counting Journal Created
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Counting Journal Created' AS ActivityName,
        ijt.CREATEDDATETIME AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        ijt.CREATEDBY AS UserId,
        ijt.ITEMID AS ItemId,
        id.INVENTLOCATIONID AS WarehouseId,
        NULL AS ReasonCode,
        ijt.QTY AS Quantity
    FROM InventJournalTrans ijt
    JOIN InventJournalTable ijtbl ON ijt.JOURNALID = ijtbl.JOURNALID AND ijt.DATAAREAID = ijtbl.DATAAREAID
    JOIN InventDim id ON ijt.INVENTDIMID = id.INVENTDIMID AND ijt.DATAAREAID = id.DATAAREAID
    WHERE ijt.DATAAREAID = @DataAreaId AND ijt.CREATEDDATETIME BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND ijtbl.JOURNALTYPE = 2 -- Counting

    UNION ALL

    -- 8. Inventory Count Performed
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Inventory Count Performed' AS ActivityName,
        ijt.MODIFIEDDATETIME AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        ijt.MODIFIEDBY AS UserId,
        ijt.ITEMID AS ItemId,
        id.INVENTLOCATIONID AS WarehouseId,
        NULL AS ReasonCode,
        ijt.COUNTED AS Quantity
    FROM InventJournalTrans ijt
    JOIN InventJournalTable ijtbl ON ijt.JOURNALID = ijtbl.JOURNALID AND ijt.DATAAREAID = ijtbl.DATAAREAID
    JOIN InventDim id ON ijt.INVENTDIMID = id.INVENTDIMID AND ijt.DATAAREAID = id.DATAAREAID
    WHERE ijt.DATAAREAID = @DataAreaId AND ijt.MODIFIEDDATETIME BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND ijtbl.JOURNALTYPE = 2 AND ijt.COUNTED IS NOT NULL AND ijt.COUNTED <> 0

    UNION ALL

    -- 9. Inventory Discrepancy Adjusted
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Inventory Discrepancy Adjusted' AS ActivityName,
        ijt.POSTEDDATETIME AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        ijt.CREATEDBY AS UserId, -- Posting is often done by the creator
        ijt.ITEMID AS ItemId,
        id.INVENTLOCATIONID AS WarehouseId,
        ijt.REASONREFRECID AS ReasonCode,
        ijt.QTY AS Quantity
    FROM InventJournalTrans ijt
    JOIN InventJournalTable ijtbl ON ijt.JOURNALID = ijtbl.JOURNALID AND ijt.DATAAREAID = ijtbl.DATAAREAID
    JOIN InventDim id ON ijt.INVENTDIMID = id.INVENTDIMID AND ijt.DATAAREAID = id.DATAAREAID
    WHERE ijt.DATAAREAID = @DataAreaId AND ijt.POSTEDDATETIME BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND ijtbl.JOURNALTYPE = 7 -- Adjustment

    UNION ALL

    -- 10. Picking Work Created
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Picking Work Created' AS ActivityName,
        whs.CREATEDDATETIME AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        whs.CREATEDBY AS UserId,
        whs.ITEMID AS ItemId,
        whs.WAREHOUSEID AS WarehouseId,
        NULL AS ReasonCode,
        whs.QTY AS Quantity
    FROM WHSWorkTable whs
    JOIN InventDim id ON whs.INVENTDIMID = id.INVENTDIMID AND whs.DATAAREAID = id.DATAAREAID
    WHERE whs.DATAAREAID = @DataAreaId AND whs.CREATEDDATETIME BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND whs.WORKTYPE = 1 -- Pick

    UNION ALL

    -- 11. Picking Completed
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Picking Completed' AS ActivityName,
        whs.CLOSEDTIMESTAMP AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        whs.MODIFIEDBY AS UserId,
        whs.ITEMID AS ItemId,
        whs.WAREHOUSEID AS WarehouseId,
        NULL AS ReasonCode,
        whs.QTY AS Quantity
    FROM WHSWorkTable whs
    JOIN InventDim id ON whs.INVENTDIMID = id.INVENTDIMID AND whs.DATAAREAID = id.DATAAREAID
    WHERE whs.DATAAREAID = @DataAreaId AND whs.CLOSEDTIMESTAMP BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND whs.WORKTYPE = 1 AND whs.WORKSTATUS = 4 -- Pick, Closed

    UNION ALL

    -- 12. Packing Completed
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Packing Completed' AS ActivityName,
        wc.CLOSEDDATETIME AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        wc.MODIFIEDBY AS UserId,
        '[Multiple Items]' AS ItemId, -- Item is not direct on container header
        wc.WAREHOUSE AS WarehouseId,
        NULL AS ReasonCode,
        NULL AS Quantity
    FROM WHSContainerTable wc
    JOIN WHSWORKTABLE whs ON wc.SHIPMENTID = whs.SHIPMENTID AND wc.DATAAREAID = whs.DATAAREAID
    JOIN InventDim id ON whs.INVENTDIMID = id.INVENTDIMID AND whs.DATAAREAID = id.DATAAREAID
    WHERE wc.DATAAREAID = @DataAreaId AND wc.CLOSEDDATETIME BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> ''

    UNION ALL

    -- 13. Goods Issue Recorded (Sales or Production)
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Goods Issue Recorded' AS ActivityName,
        it.DATEPHYSICAL AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        it.CREATEDBY AS UserId,
        it.ITEMID AS ItemId,
        id.INVENTLOCATIONID AS WarehouseId,
        NULL AS ReasonCode,
        it.QTY AS Quantity -- Quantity will be negative
    FROM InventTrans it
    JOIN InventDim id ON it.INVENTDIMID = id.INVENTDIMID AND it.DATAAREAID = id.DATAAREAID
    WHERE it.DATAAREAID = @DataAreaId AND it.DATEPHYSICAL BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND it.STATUSISSUE = 2 AND it.QTY < 0
      AND (it.TRANSTYPE = 1 OR it.TRANSTYPE = 3) -- Sales order or Production line

    UNION ALL

    -- 14. Return Goods Received
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Return Goods Received' AS ActivityName,
        it.DATEPHYSICAL AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        it.CREATEDBY AS UserId,
        it.ITEMID AS ItemId,
        id.INVENTLOCATIONID AS WarehouseId,
        NULL AS ReasonCode,
        it.QTY AS Quantity
    FROM InventTrans it
    JOIN InventDim id ON it.INVENTDIMID = id.INVENTDIMID AND it.DATAAREAID = id.DATAAREAID
    WHERE it.DATAAREAID = @DataAreaId AND it.DATEPHYSICAL BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND it.STATUSRECEIPT = 2 AND it.TRANSTYPE = 15 -- Sales return order

    UNION ALL

    -- 15. Stock Scrapped
    SELECT
        id.INVENTBATCHID AS InventoryBatchLot,
        'Stock Scrapped' AS ActivityName,
        ijt.POSTEDDATETIME AS EventTime,
        'Dynamics 365 F&O' AS SourceSystem,
        NULL AS EventEndTime,
        ijt.CREATEDBY AS UserId,
        ijt.ITEMID AS ItemId,
        id.INVENTLOCATIONID AS WarehouseId,
        ijt.REASONREFRECID AS ReasonCode,
        ijt.QTY AS Quantity
    FROM InventJournalTrans ijt
    JOIN InventJournalTable ijtbl ON ijt.JOURNALID = ijtbl.JOURNALID AND ijt.DATAAREAID = ijtbl.DATAAREAID
    JOIN InventDim id ON ijt.INVENTDIMID = id.INVENTDIMID AND ijt.DATAAREAID = id.DATAAREAID
    WHERE ijt.DATAAREAID = @DataAreaId AND ijt.POSTEDDATETIME BETWEEN @StartDate AND @EndDate
      AND id.INVENTBATCHID <> '' AND ijtbl.JOURNALTYPE = 7 -- Adjustment
      AND ijt.REASONREFRECID IN ('[YourScrapReasonCode1]', '[YourScrapReasonCode2]') -- Specify scrap reason codes

) AS T
ORDER BY T.InventoryBatchLot, T.EventTime;

import requests
import pandas as pd
import msal
import datetime
import time

class=class="hl-string">"hl-comment"># --- CONFIGURATION --- 
class=class="hl-string">"hl-comment"># Replace with your specific Dynamics 365 and Azure AD details
D365_RESOURCE = class="hl-string">"https://[your_d365_url].operations.dynamics.com"
TENANT_ID = class="hl-string">"[your_tenant_id]"
CLIENT_ID = class="hl-string">"[your_client_id]"
CLIENT_SECRET = class="hl-string">"[your_client_secret]"
COMPANY = class="hl-string">"[your_company_code]" class=class="hl-string">"hl-comment"># e.g., class="hl-string">"USMF"

class=class="hl-string">"hl-comment"># Set the date range for the extraction
START_DATE = class="hl-string">"2023-01-01"
END_DATE = class="hl-string">"2023-12-31"

class=class="hl-string">"hl-comment"># --- AUTHENTICATION --- 
def get_access_token():
    class="hl-string">"""Authenticates with Azure AD to get an access token."""
    authority = fclass="hl-string">"https://login.microsoftonline.com/{TENANT_ID}"
    app = msal.ConfidentialClientApplication(
        client_id=CLIENT_ID,
        authority=authority,
        client_credential=CLIENT_SECRET
    )
    result = app.acquire_token_for_client(scopes=[fclass="hl-string">"{D365_RESOURCE}/.default"])
    if class="hl-string">"access_token" in result:
        return result[class="hl-string">'access_token']
    else:
        raise Exception(fclass="hl-string">"Error acquiring token: {result.get('error_description')}")

class=class="hl-string">"hl-comment"># --- DATA FETCHING --- 
def fetch_data(access_token, entity_url, params):
    class="hl-string">"""Fetches data from a D365 OData entity, handling pagination."""
    headers = {
        class="hl-string">'Authorization': fclass="hl-string">'Bearer {access_token}',
        class="hl-string">'Content-Type': class="hl-string">'application/json'
    }
    all_records = []
    
    while entity_url:
        try:
            response = requests.get(entity_url, headers=headers, params=params)
            response.raise_for_status() class=class="hl-string">"hl-comment"># Raise an exception for bad status codes
            data = response.json()
            all_records.extend(data[class="hl-string">'value'])
            entity_url = data.get(class="hl-string">'@odata.nextLink')
            params = None class=class="hl-string">"hl-comment"># Parameters are only needed for the first request
        except requests.exceptions.RequestException as e:
            print(fclass="hl-string">"An error occurred: {e}")
            print(fclass="hl-string">"Response content: {response.text}")
            break class=class="hl-string">"hl-comment"># Exit loop on error
    return all_records

class=class="hl-string">"hl-comment"># --- MAIN SCRIPT --- 
def main():
    class="hl-string">"""Main function to orchestrate the data extraction process."""
    print(class="hl-string">"Acquiring access token...")
    token = get_access_token()
    all_events = []
    last_data_update = datetime.datetime.now(datetime.timezone.utc).isoformat()

    class=class="hl-string">"hl-comment"># Define queries for each activity
    activity_queries = [
        {
            class="hl-string">'activity_name': class="hl-string">'Goods Receipt Recorded',
            class="hl-string">'entity': class="hl-string">'InventoryTransactions',
            class="hl-string">'select': class="hl-string">'TransactionDate,InventDimId,ItemId,InventoryLotId,Quantity,CreatedByUserId,InventTransId',
            class="hl-string">'filter': fclass="hl-string">"TransactionDate ge {START_DATE}T00:00:00Z and TransactionDate le {END_DATE}T23:59:59Z and (IssueStatus eq Microsoft.Dynamics.DataEntities.InventIssueStatus'Purchased' or IssueStatus eq Microsoft.Dynamics.DataEntities.InventIssueStatus'Received') and Quantity gt 0",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'InventoryLotId', class="hl-string">'EventTime': class="hl-string">'TransactionDate', class="hl-string">'UserId': class="hl-string">'CreatedByUserId', class="hl-string">'ItemId': class="hl-string">'ItemId', class="hl-string">'Quantity': class="hl-string">'Quantity'}
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Quality Order Created',
            class="hl-string">'entity': class="hl-string">'QualityOrders',
            class="hl-string">'select': class="hl-string">'CreatedDateTime,QualityOrderNumber,ItemId,InventoryLotId,CreatedByUserId',
            class="hl-string">'filter': fclass="hl-string">"CreatedDateTime ge {START_DATE}T00:00:00Z and CreatedDateTime le {END_DATE}T23:59:59Z",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'InventoryLotId', class="hl-string">'EventTime': class="hl-string">'CreatedDateTime', class="hl-string">'UserId': class="hl-string">'CreatedByUserId', class="hl-string">'ItemId': class="hl-string">'ItemId'}
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Quality Inspection Performed',
            class="hl-string">'entity': class="hl-string">'QualityOrders',
            class="hl-string">'select': class="hl-string">'ModifiedDateTime,QualityOrderNumber,ItemId,InventoryLotId,ValidatedByUserId',
            class="hl-string">'filter': fclass="hl-string">"ModifiedDateTime ge {START_DATE}T00:00:00Z and ModifiedDateTime le {END_DATE}T23:59:59Z and (QualityOrderStatus eq Microsoft.Dynamics.DataEntities.InventQualityOrderStatus'Pass' or QualityOrderStatus eq Microsoft.Dynamics.DataEntities.InventQualityOrderStatus'Fail')",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'InventoryLotId', class="hl-string">'EventTime': class="hl-string">'ModifiedDateTime', class="hl-string">'UserId': class="hl-string">'ValidatedByUserId', class="hl-string">'ItemId': class="hl-string">'ItemId'}
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Put-away Work Created',
            class="hl-string">'entity': class="hl-string">'WarehouseWorkHeaders',
            class="hl-string">'select': class="hl-string">'CreatedDateTime,WorkId,LoadId,OrderNumber,InventoryLotId,WarehouseId,WorkCreatedByUserId',
            class="hl-string">'filter': fclass="hl-string">"CreatedDateTime ge {START_DATE}T00:00:00Z and CreatedDateTime le {END_DATE}T23:59:59Z and (WorkOrderType eq Microsoft.Dynamics.DataEntities.WHSWorkOrderType'Purchase' or WorkOrderType eq Microsoft.Dynamics.DataEntities.WHSWorkOrderType'FinishedGoodsPutAway')",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'InventoryLotId', class="hl-string">'EventTime': class="hl-string">'CreatedDateTime', class="hl-string">'UserId': class="hl-string">'WorkCreatedByUserId', class="hl-string">'WarehouseId': class="hl-string">'WarehouseId'}
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Put-away Completed',
            class="hl-string">'entity': class="hl-string">'WarehouseWorkHeaders',
            class="hl-string">'select': class="hl-string">'ModifiedDateTime,WorkId,LoadId,OrderNumber,InventoryLotId,WarehouseId,ClosedByUserId',
            class="hl-string">'filter': fclass="hl-string">"ModifiedDateTime ge {START_DATE}T00:00:00Z and ModifiedDateTime le {END_DATE}T23:59:59Z and WorkStatus eq Microsoft.Dynamics.DataEntities.WHSWorkStatus'Closed' and (WorkOrderType eq Microsoft.Dynamics.DataEntities.WHSWorkOrderType'Purchase' or WorkOrderType eq Microsoft.Dynamics.DataEntities.WHSWorkOrderType'FinishedGoodsPutAway')",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'InventoryLotId', class="hl-string">'EventTime': class="hl-string">'ModifiedDateTime', class="hl-string">'UserId': class="hl-string">'ClosedByUserId', class="hl-string">'WarehouseId': class="hl-string">'WarehouseId'}
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Stock Moved Internally',
            class="hl-string">'entity': class="hl-string">'WarehouseWorkHeaders',
            class="hl-string">'select': class="hl-string">'ModifiedDateTime,WorkId,InventoryLotId,WarehouseId,ClosedByUserId',
            class="hl-string">'filter': fclass="hl-string">"ModifiedDateTime ge {START_DATE}T00:00:00Z and ModifiedDateTime le {END_DATE}T23:59:59Z and WorkStatus eq Microsoft.Dynamics.DataEntities.WHSWorkStatus'Closed' and (WorkOrderType eq Microsoft.Dynamics.DataEntities.WHSWorkOrderType'InventoryMovement' or WorkOrderType eq Microsoft.Dynamics.DataEntities.WHSWorkOrderType'TransferIssue')",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'InventoryLotId', class="hl-string">'EventTime': class="hl-string">'ModifiedDateTime', class="hl-string">'UserId': class="hl-string">'ClosedByUserId', class="hl-string">'WarehouseId': class="hl-string">'WarehouseId'}
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Counting Journal Created',
            class="hl-string">'entity': class="hl-string">'InventoryCountingJournalHeaders',
            class="hl-string">'select': class="hl-string">'CreatedDateTime,JournalNumber,CreatedByUserId,WarehouseId',
            class="hl-string">'filter': fclass="hl-string">"CreatedDateTime ge {START_DATE}T00:00:00Z and CreatedDateTime le {END_DATE}T23:59:59Z",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'JournalNumber', class="hl-string">'EventTime': class="hl-string">'CreatedDateTime', class="hl-string">'UserId': class="hl-string">'CreatedByUserId', class="hl-string">'WarehouseId': class="hl-string">'WarehouseId'} class=class="hl-string">"hl-comment"># Note: Batch not directly on header
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Inventory Count Performed',
            class="hl-string">'entity': class="hl-string">'InventoryCountingJournalLines',
            class="hl-string">'select': class="hl-string">'ModifiedDateTime,JournalNumber,ItemId,InventoryLotId,CountedQuantity,ModifiedByUserId',
            class="hl-string">'filter': fclass="hl-string">"ModifiedDateTime ge {START_DATE}T00:00:00Z and ModifiedDateTime le {END_DATE}T23:59:59Z and CountedQuantity gt 0",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'InventoryLotId', class="hl-string">'EventTime': class="hl-string">'ModifiedDateTime', class="hl-string">'UserId': class="hl-string">'ModifiedByUserId', class="hl-string">'ItemId': class="hl-string">'ItemId', class="hl-string">'Quantity': class="hl-string">'CountedQuantity'}
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Inventory Discrepancy Adjusted',
            class="hl-string">'entity': class="hl-string">'InventoryCountingJournalHeaders',
            class="hl-string">'select': class="hl-string">'ModifiedDateTime,JournalNumber,PostedByUserId,WarehouseId',
            class="hl-string">'filter': fclass="hl-string">"ModifiedDateTime ge {START_DATE}T00:00:00Z and ModifiedDateTime le {END_DATE}T23:59:59Z and JournalStatus eq Microsoft.Dynamics.DataEntities.InventJournalStatus'Posted'",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'JournalNumber', class="hl-string">'EventTime': class="hl-string">'ModifiedDateTime', class="hl-string">'UserId': class="hl-string">'PostedByUserId', class="hl-string">'WarehouseId': class="hl-string">'WarehouseId'} class=class="hl-string">"hl-comment"># Note: Batch not directly on header
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Picking Work Created',
            class="hl-string">'entity': class="hl-string">'WarehouseWorkHeaders',
            class="hl-string">'select': class="hl-string">'CreatedDateTime,WorkId,InventoryLotId,WarehouseId,WorkCreatedByUserId',
            class="hl-string">'filter': fclass="hl-string">"CreatedDateTime ge {START_DATE}T00:00:00Z and CreatedDateTime le {END_DATE}T23:59:59Z and (WorkOrderType eq Microsoft.Dynamics.DataEntities.WHSWorkOrderType'Sales' or WorkOrderType eq Microsoft.Dynamics.DataEntities.WHSWorkOrderType'RawMaterialPicking')",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'InventoryLotId', class="hl-string">'EventTime': class="hl-string">'CreatedDateTime', class="hl-string">'UserId': class="hl-string">'WorkCreatedByUserId', class="hl-string">'WarehouseId': class="hl-string">'WarehouseId'}
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Picking Completed',
            class="hl-string">'entity': class="hl-string">'WarehouseWorkHeaders',
            class="hl-string">'select': class="hl-string">'ModifiedDateTime,WorkId,InventoryLotId,WarehouseId,ClosedByUserId',
            class="hl-string">'filter': fclass="hl-string">"ModifiedDateTime ge {START_DATE}T00:00:00Z and ModifiedDateTime le {END_DATE}T23:59:59Z and WorkStatus eq Microsoft.Dynamics.DataEntities.WHSWorkStatus'Closed' and (WorkOrderType eq Microsoft.Dynamics.DataEntities.WHSWorkOrderType'Sales' or WorkOrderType eq Microsoft.Dynamics.DataEntities.WHSWorkOrderType'RawMaterialPicking')",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'InventoryLotId', class="hl-string">'EventTime': class="hl-string">'ModifiedDateTime', class="hl-string">'UserId': class="hl-string">'ClosedByUserId', class="hl-string">'WarehouseId': class="hl-string">'WarehouseId'}
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Packing Completed',
            class="hl-string">'entity': class="hl-string">'WarehouseContainers',
            class="hl-string">'select': class="hl-string">'ModifiedDateTime,ContainerId,ShipmentId,ContainerPackingPolicy',
            class="hl-string">'filter': fclass="hl-string">"ModifiedDateTime ge {START_DATE}T00:00:00Z and ModifiedDateTime le {END_DATE}T23:59:59Z and IsContainerClosed eq true",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'ContainerId', class="hl-string">'EventTime': class="hl-string">'ModifiedDateTime'} class=class="hl-string">"hl-comment"># Note: Batch not directly on container entity
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Goods Issue Recorded',
            class="hl-string">'entity': class="hl-string">'InventoryTransactions',
            class="hl-string">'select': class="hl-string">'TransactionDate,InventDimId,ItemId,InventoryLotId,Quantity,CreatedByUserId,InventTransId',
            class="hl-string">'filter': fclass="hl-string">"TransactionDate ge {START_DATE}T00:00:00Z and TransactionDate le {END_DATE}T23:59:59Z and IssueStatus eq Microsoft.Dynamics.DataEntities.InventIssueStatus'Deducted' and Quantity lt 0",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'InventoryLotId', class="hl-string">'EventTime': class="hl-string">'TransactionDate', class="hl-string">'UserId': class="hl-string">'CreatedByUserId', class="hl-string">'ItemId': class="hl-string">'ItemId', class="hl-string">'Quantity': class="hl-string">'Quantity'}
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Return Goods Received',
            class="hl-string">'entity': class="hl-string">'WarehouseWorkHeaders',
            class="hl-string">'select': class="hl-string">'ModifiedDateTime,WorkId,InventoryLotId,WarehouseId,ClosedByUserId',
            class="hl-string">'filter': fclass="hl-string">"ModifiedDateTime ge {START_DATE}T00:00:00Z and ModifiedDateTime le {END_DATE}T23:59:59Z and WorkStatus eq Microsoft.Dynamics.DataEntities.WHSWorkStatus'Closed' and WorkOrderType eq Microsoft.Dynamics.DataEntities.WHSWorkOrderType'SalesReturn'",
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'InventoryLotId', class="hl-string">'EventTime': class="hl-string">'ModifiedDateTime', class="hl-string">'UserId': class="hl-string">'ClosedByUserId', class="hl-string">'WarehouseId': class="hl-string">'WarehouseId'}
        },
        {
            class="hl-string">'activity_name': class="hl-string">'Stock Scrapped',
            class="hl-string">'entity': class="hl-string">'InventoryMovementJournalLinesV2',
            class="hl-string">'select': class="hl-string">'ModifiedDateTime,JournalNumber,ItemId,InventoryLotId,Quantity,ReasonCode,ModifiedByUserId',
            class="hl-string">'filter': fclass="hl-string">"ModifiedDateTime ge {START_DATE}T00:00:00Z and ModifiedDateTime le {END_DATE}T23:59:59Z and Quantity lt 0", class=class="hl-string">"hl-comment"># Further filter by a specific ReasonCode in your system if applicable
            class="hl-string">'mapping': {class="hl-string">'InventoryBatchLot': class="hl-string">'InventoryLotId', class="hl-string">'EventTime': class="hl-string">'ModifiedDateTime', class="hl-string">'UserId': class="hl-string">'ModifiedByUserId', class="hl-string">'ItemId': class="hl-string">'ItemId', class="hl-string">'Quantity': class="hl-string">'Quantity', class="hl-string">'ReasonCode': class="hl-string">'ReasonCode'}
        },
    ]

    for query_def in activity_queries:
        print(fclass="hl-string">"Extracting: {query_def['activity_name']}...")
        entity_name = query_def[class="hl-string">'entity']
        full_url = fclass="hl-string">"{D365_RESOURCE}/data/{entity_name}"
        params = {
            class="hl-string">'$select': query_def[class="hl-string">'select'],
            class="hl-string">'$filter': query_def[class="hl-string">'filter']
        }
        records = fetch_data(token, full_url, params)
        
        for record in records:
            if not record.get(query_def[class="hl-string">'mapping'][class="hl-string">'InventoryBatchLot']):
                continue class=class="hl-string">"hl-comment"># Skip records without a batch/lot ID

            event = {
                class="hl-string">'InventoryBatchLot': record.get(query_def[class="hl-string">'mapping'][class="hl-string">'InventoryBatchLot']),
                class="hl-string">'ActivityName': query_def[class="hl-string">'activity_name'],
                class="hl-string">'EventTime': record.get(query_def[class="hl-string">'mapping'][class="hl-string">'EventTime']),
                class="hl-string">'SourceSystem': class="hl-string">'Dynamics 365 F&O',
                class="hl-string">'LastDataUpdate': last_data_update,
                class="hl-string">'EventEndTime': None,
                class="hl-string">'UserId': record.get(query_def[class="hl-string">'mapping'].get(class="hl-string">'UserId')),
                class="hl-string">'ItemId': record.get(query_def[class="hl-string">'mapping'].get(class="hl-string">'ItemId')),
                class="hl-string">'WarehouseId': record.get(query_def[class="hl-string">'mapping'].get(class="hl-string">'WarehouseId')),
                class="hl-string">'ReasonCode': record.get(query_def[class="hl-string">'mapping'].get(class="hl-string">'ReasonCode')),
                class="hl-string">'Quantity': record.get(query_def[class="hl-string">'mapping'].get(class="hl-string">'Quantity'))
            }
            all_events.append(event)
        print(fclass="hl-string">"Found {len(records)} records for {query_def['activity_name']}.")

    if not all_events:
        print(class="hl-string">"No events found for the specified criteria.")
        return

    print(class="hl-string">"\nProcessing and saving data...")
    df = pd.DataFrame(all_events)
    df[class="hl-string">'EventTime'] = pd.to_datetime(df[class="hl-string">'EventTime'])
    df.sort_values(by=[class="hl-string">'InventoryBatchLot', class="hl-string">'EventTime'], inplace=True)
    
    output_filename = class="hl-string">'inventory_event_log.csv'
    df.to_csv(output_filename, index=False, date_format=class="hl-string">'%Y-%m-%dT%H:%M:%S.%fZ')
    print(fclass="hl-string">"Extraction complete. Event log saved to {output_filename}")

if __name__ == class="hl-string">"__main__":
    main()

let
    StartDate = #datetime(2026, 1, 1, 0, 0, 0),
    EndDate = #datetime(2026, 6, 30, 23, 59, 59),
    CompanyFilter = "[Your company or legal entity filter]",
    SourceSystemValue = "Dynamics 365 F&O",
    RefreshTime = DateTime.LocalNow(),
    EmptyText = "",
    EmptyNumber = null,

    GoodsReceiptSource = [Your goods receipt source query],
    QualityOrderCreatedSource = [Your quality order created source query],
    QualityInspectionSource = [Your quality inspection source query],
    PutAwayCreatedSource = [Your put-away work created source query],
    PutAwayCompletedSource = [Your put-away completed source query],
    InternalMovementSource = [Your internal movement source query],
    CountingJournalCreatedSource = [Your counting journal created source query],
    InventoryCountPerformedSource = [Your inventory count performed source query],
    InventoryDiscrepancySource = [Your inventory discrepancy source query],
    PickingCreatedSource = [Your picking work created source query],
    PickingCompletedSource = [Your picking completed source query],
    PackingCompletedSource = [Your packing completed source query],
    GoodsIssueSource = [Your goods issue source query],
    ReturnGoodsReceivedSource = [Your return goods received source query],
    StockScrappedSource = [Your stock scrapped source query],

    StandardColumns = {"InventoryBatchLot", "ActivityName", "EventTime", "SourceSystem", "LastDataUpdate", "EventEndTime", "UserId", "ItemId", "WarehouseId", "ReasonCode", "Quantity"},

    Normalize = (SourceTable as table, Activity as text) as table =>
        let
            Selected = Table.SelectColumns(SourceTable, StandardColumns, MissingField.UseNull),
            ActivitySet = Table.TransformColumns(Selected, {{"ActivityName", each Activity, type text}}),
            SourceSet = Table.TransformColumns(ActivitySet, {{"SourceSystem", each if _ = null or _ = EmptyText then SourceSystemValue else _, type text}}),
            RefreshSet = Table.TransformColumns(SourceSet, {{"LastDataUpdate", each if _ = null then RefreshTime else _, type datetime}}),
            Typed = Table.TransformColumnTypes(RefreshSet, {{"InventoryBatchLot", type text}, {"ActivityName", type text}, {"EventTime", type datetime}, {"SourceSystem", type text}, {"LastDataUpdate", type datetime}, {"EventEndTime", type datetime}, {"UserId", type text}, {"ItemId", type text}, {"WarehouseId", type text}, {"ReasonCode", type text}, {"Quantity", type number}}),
            DateFiltered = Table.SelectRows(Typed, each [EventTime] <> null and [EventTime] >= StartDate and [EventTime] <= EndDate),
            BatchFiltered = Table.SelectRows(DateFiltered, each [InventoryBatchLot] <> null and Text.Trim([InventoryBatchLot]) <> EmptyText)
        in
            BatchFiltered,

    GoodsReceiptRecorded = Normalize(GoodsReceiptSource, "Goods Receipt Recorded"),
    QualityOrderCreated = Normalize(QualityOrderCreatedSource, "Quality Order Created"),
    QualityInspectionPerformed = Normalize(QualityInspectionSource, "Quality Inspection Performed"),
    PutAwayWorkCreated = Normalize(PutAwayCreatedSource, "Put-away Work Created"),
    PutAwayCompleted = Normalize(PutAwayCompletedSource, "Put-away Completed"),
    StockMovedInternally = Normalize(InternalMovementSource, "Stock Moved Internally"),
    CountingJournalCreated = Normalize(CountingJournalCreatedSource, "Counting Journal Created"),
    InventoryCountPerformed = Normalize(InventoryCountPerformedSource, "Inventory Count Performed"),
    InventoryDiscrepancyAdjusted = Normalize(InventoryDiscrepancySource, "Inventory Discrepancy Adjusted"),
    PickingWorkCreated = Normalize(PickingCreatedSource, "Picking Work Created"),
    PickingCompleted = Normalize(PickingCompletedSource, "Picking Completed"),
    PackingCompleted = Normalize(PackingCompletedSource, "Packing Completed"),
    GoodsIssueRecorded = Normalize(GoodsIssueSource, "Goods Issue Recorded"),
    ReturnGoodsReceived = Normalize(ReturnGoodsReceivedSource, "Return Goods Received"),
    StockScrapped = Normalize(StockScrappedSource, "Stock Scrapped"),

    EventLog = Table.Combine({GoodsReceiptRecorded, QualityOrderCreated, QualityInspectionPerformed, PutAwayWorkCreated, PutAwayCompleted, StockMovedInternally, CountingJournalCreated, InventoryCountPerformed, InventoryDiscrepancyAdjusted, PickingWorkCreated, PickingCompleted, PackingCompleted, GoodsIssueRecorded, ReturnGoodsReceived, StockScrapped}),
    Ordered = Table.Sort(EventLog, {{"InventoryBatchLot", Order.Ascending}, {"EventTime", Order.Ascending}, {"ActivityName", Order.Ascending}}),
    Final = Table.SelectColumns(Ordered, StandardColumns, MissingField.UseNull)
in
    Final