Mẫu dữ liệu quy trình mua hàng đến thanh toán, từ yêu cầu đến đơn đặt hàng

### Description of Saved Search Configurations

Below are the configurations for the required Saved Searches. The 'Results' tab columns should be created in the order listed. Use 'Custom Label' to name the columns exactly as shown.

**1. Search: ProcessMind - Purchase Requisition Events**
*   **Criteria**:
    *   Type = 'Purchase Requisition'
    *   Main Line = 'Yes'
    *   Date Created = [Your Desired Date Range]
*   **Results**:
    1.  Formula (Text): `REPLACE({createdfrom.number}, 'Purchase Order #', '')` -> Custom Label: `PurchaseOrder`
    2.  Formula (Text): `CASE WHEN {status} = 'Pending Approval' THEN 'Purchase Requisition Created' WHEN {status} = 'Approved' THEN 'Purchase Requisition Approved' ELSE NULL END` -> Custom Label: `ActivityName`
    3.  Formula (Date/Time): `CASE WHEN {status} = 'Pending Approval' THEN {datecreated} WHEN {status} = 'Approved' THEN {lastmodifieddate} ELSE NULL END` -> Custom Label: `EventTime`
    4.  Formula (Text): `'NetSuite'` -> Custom Label: `SourceSystem`
    5.  Formula (Date/Time): `{today}` -> Custom Label: `LastDataUpdate`
    6.  Field: `Created By` -> Custom Label: `UserName`
    7.  Field: `Department` -> Custom Label: `DepartmentName`
    8.  Field: `Vendor Name` -> Custom Label: `VendorName`
    9.  Field: `Status` -> Custom Label: `PurchaseOrderStatus`
    10. Field: `Amount` -> Custom Label: `TotalAmount`
    11. Field: `Class` -> Custom Label: `PurchaseCategory`

**2. Search: ProcessMind - Purchase Order Events (Wide Format)**
*   **Criteria**:
    *   Type = 'Purchase Order'
    *   Main Line = 'Yes'
    *   Date = [Your Desired Date Range]
*   **Results (Note: This search creates a wide file that must be unpivoted later)**:
    1.  Field: `Document Number` -> Custom Label: `PurchaseOrder`
    2.  Field: `Date Created` -> Custom Label: `EventTime_Purchase Order Created`
    3.  Formula (Date/Time): `CASE WHEN {status} = 'Pending Supervisor Approval' THEN {lastmodifieddate} ELSE NULL END` -> Custom Label: `EventTime_Purchase Order Submitted`
    4.  Formula (Date/Time): `CASE WHEN {approvalstatus} = 'Approved' THEN {lastmodifieddate} ELSE NULL END` -> Custom Label: `EventTime_Purchase Order Approved`
    5.  Formula (Date/Time): `CASE WHEN {approvalstatus} = 'Rejected' THEN {lastmodifieddate} ELSE NULL END` -> Custom Label: `EventTime_Purchase Order Rejected`
    6.  Formula (Date/Time): `CASE WHEN {lastmodifieddate} > {datecreated} + 1 THEN {lastmodifieddate} ELSE NULL END` -> Custom Label: `EventTime_Purchase Order Changed`
    7.  Formula (Date/Time): `CASE WHEN {status} = 'Pending Billing' OR {status} = 'Partially Received' THEN {lastmodifieddate} ELSE NULL END` -> Custom Label: `EventTime_Purchase Order Sent To Vendor`
    8.  Formula (Date/Time): `CASE WHEN {status} = 'Closed' THEN {lastmodifieddate} ELSE NULL END` -> Custom Label: `EventTime_Purchase Order Closed`
    9.  Field: `Created By` -> Custom Label: `UserName`
    10. Field: `Department` -> Custom Label: `DepartmentName`
    11. Field: `Vendor Name` -> Custom Label: `VendorName`
    12. Field: `Status` -> Custom Label: `PurchaseOrderStatus`
    13. Field: `Total Amount` -> Custom Label: `TotalAmount`
    14. Field: `Class` -> Custom Label: `PurchaseCategory`

**3. Search: ProcessMind - Item Receipt Events**
*   **Criteria**:
    *   Type = 'Item Receipt'
    *   Main Line = 'Yes'
    *   Date Created = [Your Desired Date Range]
*   **Results**:
    1.  Field: `Created From : Document Number` -> Custom Label: `PurchaseOrder`
    2.  Formula (Text): `'Item Receipt Created'` -> Custom Label: `ActivityName`
    3.  Field: `Date Created` -> Custom Label: `EventTime`
    4.  Formula (Text): `'NetSuite'` -> Custom Label: `SourceSystem`
    5.  Formula (Date/Time): `{today}` -> Custom Label: `LastDataUpdate`
    6.  Field: `Created By` -> Custom Label: `UserName`
    7.  Field: `Created From : Department` -> Custom Label: `DepartmentName`
    8.  Field: `Created From : Vendor Name` -> Custom Label: `VendorName`
    9.  Field: `Created From : Status` -> Custom Label: `PurchaseOrderStatus`
    10. Field: `Created From : Total Amount` -> Custom Label: `TotalAmount`
    11. Field: `Created From : Class` -> Custom Label: `PurchaseCategory`

**4. Search: ProcessMind - Billing Events**
*   **Criteria**:
    *   Type = any of 'Vendor Bill', 'Vendor Payment'
    *   Main Line = 'Yes'
    *   Date = [Your Desired Date Range]
*   **Results**:
    1.  Field: `Created From : Document Number` -> Custom Label: `PurchaseOrder`
    2.  Formula (Text): `CASE WHEN {type} = 'Vendor Bill' AND {approvalstatus} <> 'Approved' THEN 'Bill Created From Purchase Order' WHEN {type} = 'Vendor Bill' AND {approvalstatus} = 'Approved' THEN 'Bill Approved' WHEN {type} = 'Vendor Payment' THEN 'Bill Payment Made' ELSE NULL END` -> Custom Label: `ActivityName`
    3.  Field: `Date` -> Custom Label: `EventTime`
    4.  Formula (Text): `'NetSuite'` -> Custom Label: `SourceSystem`
    5.  Formula (Date/Time): `{today}` -> Custom Label: `LastDataUpdate`
    6.  Field: `Created By` -> Custom Label: `UserName`
    7.  Field: `Created From : Department` -> Custom Label: `DepartmentName`
    8.  Field: `Created From : Vendor Name` -> Custom Label: `VendorName`
    9.  Field: `Created From : Status` -> Custom Label: `PurchaseOrderStatus`
    10. Field: `Created From : Total Amount` -> Custom Label: `TotalAmount`
    11. Field: `Created From : Class` -> Custom Label: `PurchaseCategory`

WITH Transactions_CTE AS (
  SELECT
    T.Transaction_ID,
    T.TranID,
    T.Type,
    T.Status,
    T.ApprovalStatus,
    T.DateCreated,
    T.LastModifiedDate,
    T.Entity_ID AS Vendor_ID,
    T.CreatedBy_ID,
    T.Total,
    T.Department_ID,
    T.ToBeEmailed,
    TL.CreatedFrom_ID,
    -- Placeholder for a custom field. Replace with your actual field ID.
    T.custbody_purchase_category AS PurchaseCategory_ID 
  FROM
    Transaction AS T
    LEFT JOIN TransactionLine AS TL ON T.Transaction_ID = TL.Transaction_ID
  WHERE
    (T.Type IN ('PurchOrd', 'PurchReq', 'ItemRcpt', 'VendBill', 'VendPymt'))
    AND T.DateCreated >= TO_DATE('[YYYY-MM-DD]', 'YYYY-MM-DD') -- Set Start Date
    -- Optional: Add a subsidiary filter for multi-subsidiary environments
    -- AND T.Subsidiary_ID = [Your Subsidiary ID] 
    AND TL.MainLine = 'T' -- Focus on main line data to avoid row duplication
)
-- 1. Purchase Requisition Created
SELECT
  PR_PO_Map.PO_TranID AS "PurchaseOrder",
  'Purchase Requisition Created' AS "ActivityName",
  PR.DateCreated AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS PR
  JOIN TransactionLine AS PR_Line ON PR.Transaction_ID = PR_Line.Transaction_ID
  JOIN Transaction AS PO_Link ON PR_Line.Transaction_ID = PO_Link.AppliedToTransaction_ID
  JOIN Transactions_CTE AS PO ON PO_Link.Transaction_ID = PO.Transaction_ID
  LEFT JOIN Employee AS E_User ON PR.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PR.Department_ID = D.Department_ID
  CROSS JOIN (
      SELECT DISTINCT PO_Ref.TranID AS PO_TranID, PR_Ref.Transaction_ID AS PR_ID
      FROM Transaction AS PO_Ref JOIN TransactionLine AS TL_Ref ON PO_Ref.Transaction_ID = TL_Ref.Transaction_ID JOIN Transaction AS PR_Ref ON TL_Ref.CreatedFrom_ID = PR_Ref.Transaction_ID
      WHERE PO_Ref.Type = 'PurchOrd' AND PR_Ref.Type = 'PurchReq'
  ) AS PR_PO_Map ON PR.Transaction_ID = PR_PO_Map.PR_ID
WHERE
  PR.Type = 'PurchReq'

UNION ALL

-- 2. Purchase Requisition Approved
SELECT
  PR_PO_Map.PO_TranID AS "PurchaseOrder",
  'Purchase Requisition Approved' AS "ActivityName",
  PR.LastModifiedDate AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS PR
  JOIN TransactionLine AS PR_Line ON PR.Transaction_ID = PR_Line.Transaction_ID
  JOIN Transaction AS PO_Link ON PR_Line.Transaction_ID = PO_Link.AppliedToTransaction_ID
  JOIN Transactions_CTE AS PO ON PO_Link.Transaction_ID = PO.Transaction_ID
  LEFT JOIN Employee AS E_User ON PR.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PR.Department_ID = D.Department_ID
  CROSS JOIN (
      SELECT DISTINCT PO_Ref.TranID AS PO_TranID, PR_Ref.Transaction_ID AS PR_ID
      FROM Transaction AS PO_Ref JOIN TransactionLine AS TL_Ref ON PO_Ref.Transaction_ID = TL_Ref.Transaction_ID JOIN Transaction AS PR_Ref ON TL_Ref.CreatedFrom_ID = PR_Ref.Transaction_ID
      WHERE PO_Ref.Type = 'PurchOrd' AND PR_Ref.Type = 'PurchReq'
  ) AS PR_PO_Map ON PR.Transaction_ID = PR_PO_Map.PR_ID
WHERE
  PR.Type = 'PurchReq'
  AND BUILTIN.DF(PR.ApprovalStatus) = 'Approved'

UNION ALL

-- 3. Purchase Order Created
SELECT
  PO.TranID AS "PurchaseOrder",
  'Purchase Order Created' AS "ActivityName",
  PO.DateCreated AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS PO
  LEFT JOIN Employee AS E_User ON PO.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PO.Department_ID = D.Department_ID
WHERE
  PO.Type = 'PurchOrd'

UNION ALL

-- 4. Purchase Order Submitted
SELECT
  PO.TranID AS "PurchaseOrder",
  'Purchase Order Submitted' AS "ActivityName",
  PO.LastModifiedDate AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS PO
  LEFT JOIN Employee AS E_User ON PO.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PO.Department_ID = D.Department_ID
WHERE
  PO.Type = 'PurchOrd'
  AND BUILTIN.DF(PO.ApprovalStatus) = 'Pending Approval' AND PO.LastModifiedDate > PO.DateCreated

UNION ALL

-- 5. Purchase Order Approved
SELECT
  PO.TranID AS "PurchaseOrder",
  'Purchase Order Approved' AS "ActivityName",
  PO.LastModifiedDate AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS PO
  LEFT JOIN Employee AS E_User ON PO.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PO.Department_ID = D.Department_ID
WHERE
  PO.Type = 'PurchOrd'
  AND BUILTIN.DF(PO.ApprovalStatus) = 'Approved'

UNION ALL

-- 6. Purchase Order Rejected
SELECT
  PO.TranID AS "PurchaseOrder",
  'Purchase Order Rejected' AS "ActivityName",
  PO.LastModifiedDate AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS PO
  LEFT JOIN Employee AS E_User ON PO.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PO.Department_ID = D.Department_ID
WHERE
  PO.Type = 'PurchOrd'
  AND BUILTIN.DF(PO.ApprovalStatus) = 'Rejected'

UNION ALL

-- 7. Purchase Order Changed
SELECT
  PO.TranID AS "PurchaseOrder",
  'Purchase Order Changed' AS "ActivityName",
  PO.LastModifiedDate AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS PO
  LEFT JOIN Employee AS E_User ON PO.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PO.Department_ID = D.Department_ID
WHERE
  PO.Type = 'PurchOrd'
  AND PO.LastModifiedDate > PO.DateCreated

UNION ALL

-- 8. Purchase Order Sent To Vendor
SELECT
  PO.TranID AS "PurchaseOrder",
  'Purchase Order Sent To Vendor' AS "ActivityName",
  PO.LastModifiedDate AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS PO
  LEFT JOIN Employee AS E_User ON PO.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PO.Department_ID = D.Department_ID
WHERE
  PO.Type = 'PurchOrd'
  AND PO.ToBeEmailed = 'F' -- Assumes the PO was sent via email

UNION ALL

-- 9. Item Receipt Created
SELECT
  PO.TranID AS "PurchaseOrder",
  'Item Receipt Created' AS "ActivityName",
  IR.DateCreated AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS IR
  JOIN Transactions_CTE AS PO ON IR.CreatedFrom_ID = PO.Transaction_ID
  LEFT JOIN Employee AS E_User ON IR.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PO.Department_ID = D.Department_ID
WHERE
  IR.Type = 'ItemRcpt' AND PO.Type = 'PurchOrd'

UNION ALL

-- 10. Quality Inspection Performed
SELECT
  PO.TranID AS "PurchaseOrder",
  'Quality Inspection Performed' AS "ActivityName",
  IR.LastModifiedDate AS "EventTime", -- Assuming date is updated on the Item Receipt
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS IR
  JOIN Transactions_CTE AS PO ON IR.CreatedFrom_ID = PO.Transaction_ID
  LEFT JOIN Employee AS E_User ON IR.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PO.Department_ID = D.Department_ID
WHERE
  IR.Type = 'ItemRcpt' AND PO.Type = 'PurchOrd'
  -- This part is a placeholder. It assumes a custom checkbox `custbody_quality_inspected` is checked
  -- to indicate inspection. Adjust the field ID and logic based on your NetSuite configuration.
  AND IR.custbody_quality_inspected = 'T'

UNION ALL

-- 11. Bill Created From Purchase Order
SELECT
  PO.TranID AS "PurchaseOrder",
  'Bill Created From Purchase Order' AS "ActivityName",
  VB.DateCreated AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS VB
  JOIN Transactions_CTE AS PO ON VB.CreatedFrom_ID = PO.Transaction_ID
  LEFT JOIN Employee AS E_User ON VB.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PO.Department_ID = D.Department_ID
WHERE
  VB.Type = 'VendBill' AND PO.Type = 'PurchOrd'

UNION ALL

-- 12. Bill Approved
SELECT
  PO.TranID AS "PurchaseOrder",
  'Bill Approved' AS "ActivityName",
  VB.LastModifiedDate AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS VB
  JOIN Transactions_CTE AS PO ON VB.CreatedFrom_ID = PO.Transaction_ID
  LEFT JOIN Employee AS E_User ON VB.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PO.Department_ID = D.Department_ID
WHERE
  VB.Type = 'VendBill' AND PO.Type = 'PurchOrd'
  AND BUILTIN.DF(VB.ApprovalStatus) = 'Approved'

UNION ALL

-- 13. Bill Payment Made
SELECT
  PO.TranID AS "PurchaseOrder",
  'Bill Payment Made' AS "ActivityName",
  VP.DateCreated AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS VP
  JOIN TransactionLink AS VL ON VP.Transaction_ID = VL.Transaction_ID AND VL.LinkType = 'Applied To'
  JOIN Transactions_CTE AS VB ON VL.PreviousTransaction_ID = VB.Transaction_ID
  JOIN Transactions_CTE AS PO ON VB.CreatedFrom_ID = PO.Transaction_ID
  LEFT JOIN Employee AS E_User ON VP.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PO.Department_ID = D.Department_ID
WHERE
  VP.Type = 'VendPymt' AND VB.Type = 'VendBill' AND PO.Type = 'PurchOrd'

UNION ALL

-- 14. Purchase Order Closed
SELECT
  PO.TranID AS "PurchaseOrder",
  'Purchase Order Closed' AS "ActivityName",
  PO.LastModifiedDate AS "EventTime",
  'NetSuite' AS "SourceSystem",
  CURRENT_TIMESTAMP AS "LastDataUpdate",
  BUILTIN.DF(E_User.Employee_ID) AS "UserName",
  BUILTIN.DF(D.Department_ID) AS "DepartmentName",
  BUILTIN.DF(PO.Vendor_ID) AS "VendorName",
  BUILTIN.DF(PO.Status) AS "PurchaseOrderStatus",
  PO.Total AS "TotalAmount",
  BUILTIN.DF(PO.PurchaseCategory_ID) AS "PurchaseCategory"
FROM
  Transactions_CTE AS PO
  LEFT JOIN Employee AS E_User ON PO.CreatedBy_ID = E_User.Employee_ID
  LEFT JOIN Department AS D ON PO.Department_ID = D.Department_ID
WHERE
  PO.Type = 'PurchOrd'
  AND BUILTIN.DF(PO.Status) = 'Closed';

import requests
from requests_oauthlib import OAuth1
import json
import pandas as pd
from datetime import datetime

class=class="hl-string">"hl-comment"># --- Configuration: Replace with your NetSuite Credentials ---
class=class="hl-string">"hl-comment"># Your NetSuite Account ID (e.g., 1234567 or 1234567_SB1 for sandbox)
ACCOUNT_ID = class="hl-string">"[Your NetSuite Account ID]"

class=class="hl-string">"hl-comment"># Token-Based Authentication Credentials
CONSUMER_KEY = class="hl-string">"[Your Consumer Key]"
CONSUMER_SECRET = class="hl-string">"[Your Consumer Secret]"
TOKEN_ID = class="hl-string">"[Your Token ID]"
TOKEN_SECRET = class="hl-string">"[Your Token Secret]"

class=class="hl-string">"hl-comment"># --- Script Settings ---
class=class="hl-string">"hl-comment"># The script will stop if it encounters this many consecutive errors.
MAX_CONSECUTIVE_ERRORS = 5

class=class="hl-string">"hl-comment"># Construct the base URL for the SuiteQL endpoint
class=class="hl-string">"hl-comment"># Use class="hl-string">'suitetalk.api.netsuite.com' for production or class="hl-string">'suitetalk.api.sandbox.netsuite.com' for sandbox
base_url = fclass="hl-string">"https://{ACCOUNT_ID.lower().replace('_', '-')}.suitetalk.api.netsuite.com"
suiteql_url = fclass="hl-string">"{base_url}/services/rest/query/v1/suiteql"

class=class="hl-string">"hl-comment"># --- SuiteQL Query ---
class=class="hl-string">"hl-comment"># This query extracts events for the Purchase-to-Pay process centered on Purchase Orders.
class=class="hl-string">"hl-comment"># !! IMPORTANT !!: Replace class="hl-string">'YYYY-MM-DD' with your desired start and end dates.
suiteql_query = class="hl-string">"""
SELECT
    po.tranId AS PurchaseOrder,
    'Purchase Requisition Created' AS ActivityName,
    req.tranDate AS EventTime,
    BUILTIN.DF(req.entity) AS UserName,
    BUILTIN.DF(req.department) AS DepartmentName,
    NULL AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(req.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    Transaction AS req
    INNER JOIN Transaction AS po ON req.ID = po.createdFrom
WHERE
    req.type = 'PurchReq'
    AND po.type = 'PurchOrd'
    AND req.lastModifiedDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

SELECT
    po.tranId AS PurchaseOrder,
    'Purchase Requisition Approved' AS ActivityName,
    note.noteDate AS EventTime,
    BUILTIN.DF(note.author) AS UserName,
    BUILTIN.DF(req.department) AS DepartmentName,
    NULL AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(req.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    SystemNote AS note
    INNER JOIN Transaction AS req ON note.recordId = req.ID
    INNER JOIN Transaction AS po ON req.ID = po.createdFrom
WHERE
    req.type = 'PurchReq'
    AND po.type = 'PurchOrd'
    AND note.field = 'TRN_APPROVALSTATUS'
    AND note.newValue = 'Approved'
    AND note.noteDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

SELECT
    po.tranId AS PurchaseOrder,
    'Purchase Order Created' AS ActivityName,
    po.tranDate AS EventTime,
    BUILTIN.DF(po.createdBy) AS UserName,
    BUILTIN.DF(po.department) AS DepartmentName,
    BUILTIN.DF(po.entity) AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(po.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    Transaction AS po
WHERE
    po.type = 'PurchOrd'
    AND po.lastModifiedDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

SELECT
    po.tranId AS PurchaseOrder,
    'Purchase Order Submitted' AS ActivityName,
    note.noteDate AS EventTime,
    BUILTIN.DF(note.author) AS UserName,
    BUILTIN.DF(po.department) AS DepartmentName,
    BUILTIN.DF(po.entity) AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(po.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    SystemNote AS note
    INNER JOIN Transaction AS po ON note.recordId = po.ID
WHERE
    po.type = 'PurchOrd'
    AND note.field = 'TRN_APPROVALSTATUS'
    AND note.newValue LIKE 'Pending%'
    AND note.noteDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

SELECT
    po.tranId AS PurchaseOrder,
    'Purchase Order Approved' AS ActivityName,
    note.noteDate AS EventTime,
    BUILTIN.DF(note.author) AS UserName,
    BUILTIN.DF(po.department) AS DepartmentName,
    BUILTIN.DF(po.entity) AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(po.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    SystemNote AS note
    INNER JOIN Transaction AS po ON note.recordId = po.ID
WHERE
    po.type = 'PurchOrd'
    AND note.field = 'TRN_APPROVALSTATUS'
    AND note.newValue = 'Approved'
    AND note.noteDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

SELECT
    po.tranId AS PurchaseOrder,
    'Purchase Order Rejected' AS ActivityName,
    note.noteDate AS EventTime,
    BUILTIN.DF(note.author) AS UserName,
    BUILTIN.DF(po.department) AS DepartmentName,
    BUILTIN.DF(po.entity) AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(po.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    SystemNote AS note
    INNER JOIN Transaction AS po ON note.recordId = po.ID
WHERE
    po.type = 'PurchOrd'
    AND note.field = 'TRN_APPROVALSTATUS'
    AND note.newValue = 'Rejected'
    AND note.noteDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

SELECT DISTINCT
    po.tranId AS PurchaseOrder,
    'Purchase Order Changed' AS ActivityName,
    po.lastModifiedDate AS EventTime,
    BUILTIN.DF(po.lastModifiedBy) AS UserName,
    BUILTIN.DF(po.department) AS DepartmentName,
    BUILTIN.DF(po.entity) AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(po.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    Transaction AS po
WHERE
    po.type = 'PurchOrd'
    AND po.lastModifiedDate > po.dateCreated
    AND po.lastModifiedDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

SELECT
    po.tranId AS PurchaseOrder,
    'Purchase Order Sent To Vendor' AS ActivityName,
    note.noteDate AS EventTime,
    BUILTIN.DF(note.author) AS UserName,
    BUILTIN.DF(po.department) AS DepartmentName,
    BUILTIN.DF(po.entity) AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(po.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    SystemNote AS note
    INNER JOIN Transaction AS po ON note.recordId = po.ID
WHERE
    po.type = 'PurchOrd'
    AND note.field = 'TRN_TOBEEMAILED' AND note.newValue = 'No'
    AND note.noteDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

SELECT
    BUILTIN.DF(ir.createdFrom) AS PurchaseOrder,
    'Item Receipt Created' AS ActivityName,
    ir.tranDate AS EventTime,
    BUILTIN.DF(ir.createdBy) AS UserName,
    BUILTIN.DF(po.department) AS DepartmentName,
    BUILTIN.DF(po.entity) AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(po.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    Transaction AS ir
    INNER JOIN Transaction AS po ON ir.createdFrom = po.ID
WHERE
    ir.type = 'ItemRcpt'
    AND po.type = 'PurchOrd'
    AND ir.lastModifiedDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

-- Placeholder for Quality Inspection. This requires a custom field or record.
-- This query assumes a custom checkbox field 'custbody_quality_inspection_done' on the Item Receipt.
-- Please update 'custbody_quality_inspection_done' with your actual custom field ID.
SELECT
    BUILTIN.DF(ir.createdFrom) AS PurchaseOrder,
    'Quality Inspection Performed' AS ActivityName,
    note.noteDate AS EventTime,
    BUILTIN.DF(note.author) AS UserName,
    BUILTIN.DF(po.department) AS DepartmentName,
    BUILTIN.DF(po.entity) AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(po.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    SystemNote note
    INNER JOIN Transaction ir ON note.recordId = ir.ID
    INNER JOIN Transaction po ON ir.createdFrom = po.ID
WHERE
    ir.type = 'ItemRcpt'
    AND note.field = 'CUSTBODY_QUALITY_INSPECTION_DONE'
    AND note.newValue = 'Yes'
    AND note.noteDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

SELECT
    BUILTIN.DF(bill.createdFrom) AS PurchaseOrder,
    'Bill Created From Purchase Order' AS ActivityName,
    bill.tranDate AS EventTime,
    BUILTIN.DF(bill.createdBy) AS UserName,
    BUILTIN.DF(po.department) AS DepartmentName,
    BUILTIN.DF(bill.entity) AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(po.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    Transaction AS bill
    INNER JOIN Transaction AS po ON bill.createdFrom = po.ID
WHERE
    bill.type = 'VendBill'
    AND po.type = 'PurchOrd'
    AND bill.lastModifiedDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

SELECT
    BUILTIN.DF(po.tranId) AS PurchaseOrder,
    'Bill Approved' AS ActivityName,
    note.noteDate AS EventTime,
    BUILTIN.DF(note.author) AS UserName,
    BUILTIN.DF(po.department) AS DepartmentName,
    BUILTIN.DF(bill.entity) AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(po.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    SystemNote AS note
    INNER JOIN Transaction AS bill ON note.recordId = bill.ID
    INNER JOIN transactionLine tl ON bill.id = tl.transaction
    INNER JOIN transaction po ON tl.createdFrom = po.id
WHERE
    bill.type = 'VendBill'
    AND po.type = 'PurchOrd'
    AND note.field = 'TRN_APPROVALSTATUS'
    AND note.newValue = 'Approved'
    AND note.noteDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

SELECT
    BUILTIN.DF(po.tranId) AS PurchaseOrder,
    'Bill Payment Made' AS ActivityName,
    payment.tranDate AS EventTime,
    BUILTIN.DF(payment.createdBy) AS UserName,
    BUILTIN.DF(po.department) AS DepartmentName,
    BUILTIN.DF(payment.entity) AS VendorName,
    BUILTIN.DF(po.status) AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(po.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    Transaction AS payment
    INNER JOIN TransactionLine AS paymentLine ON payment.id = paymentLine.transaction
    INNER JOIN Transaction AS bill ON paymentLine.appliedToTransaction = bill.id
    INNER JOIN TransactionLine AS billLine ON bill.id = billLine.transaction
    INNER JOIN Transaction AS po ON billLine.createdFrom = po.id
WHERE
    payment.type = 'VendPymt'
    AND bill.type = 'VendBill'
    AND po.type = 'PurchOrd'
    AND payment.lastModifiedDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')

UNION ALL

SELECT
    po.tranId AS PurchaseOrder,
    'Purchase Order Closed' AS ActivityName,
    note.noteDate AS EventTime,
    BUILTIN.DF(note.author) AS UserName,
    BUILTIN.DF(po.department) AS DepartmentName,
    BUILTIN.DF(po.entity) AS VendorName,
    'Closed' AS PurchaseOrderStatus,
    po.total AS TotalAmount,
    BUILTIN.DF(po.class) AS PurchaseCategory,
    'NetSuite' AS SourceSystem,
    CURRENT_TIMESTAMP AS LastDataUpdate
FROM
    SystemNote AS note
    INNER JOIN Transaction AS po ON note.recordId = po.ID
WHERE
    po.type = 'PurchOrd'
    AND note.field = 'TRN_STATUS'
    AND note.newValue = 'Closed'
    AND note.noteDate >= TO_DATE('2023-01-01', 'YYYY-MM-DD')
"""

def execute_suiteql(query, oauth_session, limit=1000, offset=0):
    class="hl-string">"""Executes a SuiteQL query and returns the JSON response."""
    headers = {
        class="hl-string">'Prefer': class="hl-string">'transient',
        class="hl-string">'Content-Type': class="hl-string">'application/json'
    }
    payload = {
        class="hl-string">'q': query,
        class="hl-string">'limit': limit,
        class="hl-string">'offset': offset
    }
    try:
        response = oauth_session.post(suiteql_url, json=payload, headers=headers)
        response.raise_for_status()  class=class="hl-string">"hl-comment"># Raises an HTTPError for bad responses (4xx or 5xx)
        return response.json()
    except requests.exceptions.HTTPError as e:
        print(fclass="hl-string">"HTTP Error: {e.response.status_code} {e.response.reason}")
        print(fclass="hl-string">"Response body: {e.response.text}")
    except requests.exceptions.RequestException as e:
        print(fclass="hl-string">"Request Error: {e}")
    return None

def main():
    class="hl-string">"""Main function to run the data extraction process."""
    print(class="hl-string">"Starting NetSuite P2P data extraction...")

    class=class="hl-string">"hl-comment"># Set up OAuth1 session
    oauth = OAuth1(
        client_key=CONSUMER_KEY,
        client_secret=CONSUMER_SECRET,
        resource_owner_key=TOKEN_ID,
        resource_owner_secret=TOKEN_SECRET,
        realm=ACCOUNT_ID,
        signature_method=class="hl-string">'HMAC-SHA256'
    )

    all_results = []
    offset = 0
    limit = 1000  class=class="hl-string">"hl-comment"># NetSuite's max page size for SuiteQL
    consecutive_errors = 0

    with requests.Session() as session:
        session.auth = oauth
        while True:
            if consecutive_errors >= MAX_CONSECUTIVE_ERRORS:
                print(fclass="hl-string">"Stopping due to {MAX_CONSECUTIVE_ERRORS} consecutive errors.")
                break

            print(fclass="hl-string">"Fetching records with offset: {offset}...")
            data = execute_suiteql(suiteql_query, session, limit, offset)

            if data and class="hl-string">'items' in data:
                consecutive_errors = 0
                items = data[class="hl-string">'items']
                class=class="hl-string">"hl-comment"># The structure of items is a list of dictionaries with key class="hl-string">'links' and other keys as data
                class=class="hl-string">"hl-comment"># We need to flatten this structure.
                for item in items:
                    flat_item = {k: v for k, v in item.items() if k != class="hl-string">'links'}
                    all_results.append(flat_item)

                if data.get(class="hl-string">'hasMore', False):
                    offset = data.get(class="hl-string">'offset', offset) + data.get(class="hl-string">'count', limit)
                else:
                    print(class="hl-string">"No more records to fetch.")
                    break
            elif data is None: class=class="hl-string">"hl-comment"># An error occurred in execute_suiteql
                consecutive_errors += 1
                print(fclass="hl-string">"Retrying... (Attempt {consecutive_errors})")
            else: class=class="hl-string">"hl-comment"># No items in response, or malformed response
                print(class="hl-string">"No items found in the response or response was malformed. Stopping.")
                break

    if not all_results:
        print(class="hl-string">"Extraction complete, but no data was returned.")
        return

    class=class="hl-string">"hl-comment"># Convert results to a pandas DataFrame
    df = pd.DataFrame(all_results)

    class=class="hl-string">"hl-comment"># Data type conversions and formatting
    if class="hl-string">'eventtime' in df.columns:
        df[class="hl-string">'eventtime'] = pd.to_datetime(df[class="hl-string">'eventtime'])

    if class="hl-string">'lastdataupdate' in df.columns:
        df[class="hl-string">'lastdataupdate'] = pd.to_datetime(df[class="hl-string">'lastdataupdate'])

    class=class="hl-string">"hl-comment"># Rename columns to match the required schema
    column_mapping = {
        class="hl-string">'purchaseorder': class="hl-string">'PurchaseOrder',
        class="hl-string">'activityname': class="hl-string">'ActivityName',
        class="hl-string">'eventtime': class="hl-string">'EventTime',
        class="hl-string">'sourcesystem': class="hl-string">'SourceSystem',
        class="hl-string">'lastdataupdate': class="hl-string">'LastDataUpdate',
        class="hl-string">'username': class="hl-string">'UserName',
        class="hl-string">'departmentname': class="hl-string">'DepartmentName',
        class="hl-string">'vendorname': class="hl-string">'VendorName',
        class="hl-string">'purchaseorderstatus': class="hl-string">'PurchaseOrderStatus',
        class="hl-string">'totalamount': class="hl-string">'TotalAmount',
        class="hl-string">'purchasecategory': class="hl-string">'PurchaseCategory'
    }
    df.rename(columns=column_mapping, inplace=True)
    
    class=class="hl-string">"hl-comment"># Save to CSV
    output_filename = class="hl-string">'netsuite_p2p_event_log.csv'
    df.to_csv(output_filename, index=False, date_format=class="hl-string">'%Y-%m-%dT%H:%M:%S.%f')
    print(fclass="hl-string">"Successfully extracted {len(df)} events.")
    print(fclass="hl-string">"Event log saved to {output_filename}")

if __name__ == class="hl-string">"__main__":
    main()