Seu Template de Dados de Gestão da Qualidade

/*
This is a configuration guide for building the report in the MasterControl Analytics UI.
There is no executable SQL script, as the extraction is performed through the graphical interface.
Follow these steps in the report builder to configure your data extraction.
*/

**1. Report Data Source (Universe):**
Select a data source that combines Quality Event data with Audit Trail information. Example: `[Quality Events and Audit History]`

**2. Result Objects (Columns to Select):**

-- Case and Recommended Attributes
*   `InfoCard.ID` (as QualityEvent)
*   `InfoCard.Fields.[Quality Event Type]` (as QualityEventType)
*   `InfoCard.Fields.[Responsible Department]` (as ResponsibleDepartment)
*   `InfoCard.Fields.[Root Cause Category]` (as RootCauseCategory)
*   `InfoCard.Fields.[Effectiveness Status]` (as EffectivenessStatus)
*   `InfoCard.Fields.[Target Resolution Date]` (as TargetResolutionDate)
*   `InfoCard.Status` (as QualityEventStatus)

-- Required Activity Attributes
*   `Audit Trail.Record Type` or `Audit Trail.Action` (as ActivityName)
*   `Audit Trail.Date/Time` (as EventTime)
*   `Audit Trail.User Name` or `Audit Trail.Performed By` (as UserName)

**3. Query Filters (Filter Pane):**

*   **Filter 1: Date Range**
    *   Object: `Audit Trail.Date/Time`
    *   Operator: `Between`
    *   Values: `[Select a start date]` and `[Select an end date]`

*   **Filter 2: Activity Types**
    *   Object: `Audit Trail.Record Type`
    *   Operator: `In List`
    *   Values: Select all relevant system events. The exact names may vary in your configuration. You must map these technical names to the required business activity names post-export. Look for values similar to:
        *   `Create InfoCard` (maps to 'Quality Event Created')
        *   `Status Change` (used for 'Initial Triage Completed', 'Investigation Initiated', 'Quality Event Closed', 'Quality Event Cancelled')
        *   `Task Complete` (used for 'Root Cause Analysis Performed', 'Corrective Action Implemented', 'Preventive Action Implemented', 'Effectiveness of Action Verified', 'Stakeholders Notified')
        *   `Task Failed` (maps to 'Effectiveness Deemed Ineffective')
        *   `E-Signature Applied` (maps to 'Corrective Action Plan Approved', 'Final Review Conducted')
        *   `Link Created` (maps to 'Corrective Action Plan Proposed' when a CAPA is linked)

*   **Filter 3 (Optional): Quality Event Type**
    *   Object: `InfoCard.Fields.[Quality Event Type]`
    *   Operator: `In List`
    *   Values: `[Select desired event types, e.g., 'Non-conformance', 'Deviation']`

**4. Post-Export Transformation:**
After exporting to CSV, you must add a data transformation step to map the raw `Audit Trail.Record Type` and `InfoCard.Status` values to the standardized `ActivityName` values required by ProcessMind. For example, an audit record where `Record Type` is 'Status Change' and the new status is 'Closed' should be mapped to the `ActivityName` 'Quality Event Closed'.

import requests
import pandas as pd
import json
from datetime import datetime

class=class="hl-string">"hl-comment"># --- Configuration Settings --- 
class=class="hl-string">"hl-comment"># Replace with your MasterControl instance details
BASE_URL = class="hl-string">"https://[Your-MasterControl-Domain].mastercontrol.com"
CLIENT_ID = class="hl-string">"[Your_Client_ID]"
CLIENT_SECRET = class="hl-string">"[Your_Client_Secret]"
API_KEY = class="hl-string">"[Your_API_Key]"

class=class="hl-string">"hl-comment"># --- Date Range for Extraction --- 
class=class="hl-string">"hl-comment"># Format: YYYY-MM-DD
START_DATE = class="hl-string">"2023-01-01"
END_DATE = class="hl-string">"2023-12-31"

class=class="hl-string">"hl-comment"># --- Authentication Function --- 
def get_access_token():
    class="hl-string">"""Authenticates with MasterControl and returns an access token."""
    auth_url = fclass="hl-string">"{BASE_URL}/api/v2/auth/token"
    auth_payload = {
        class="hl-string">'grant_type': class="hl-string">'password',
        class="hl-string">'client_id': CLIENT_ID,
        class="hl-string">'client_secret': CLIENT_SECRET
    }
    headers = {
        class="hl-string">'x-api-key': API_KEY,
        class="hl-string">'Content-Type': class="hl-string">'application/json'
    }
    try:
        response = requests.post(auth_url, headers=headers, data=json.dumps(auth_payload))
        response.raise_for_status() class=class="hl-string">"hl-comment"># Raises an HTTPError for bad responses
        return response.json().get(class="hl-string">'access_token')
    except requests.exceptions.RequestException as e:
        print(fclass="hl-string">"Error during authentication: {e}")
        return None

class=class="hl-string">"hl-comment"># --- Main Extraction Logic --- 
def extract_quality_events():
    class="hl-string">"""Extracts, transforms, and returns a DataFrame of quality event activities."""
    token = get_access_token()
    if not token:
        print(class="hl-string">"Could not retrieve access token. Exiting.")
        return pd.DataFrame()

    headers = {
        class="hl-string">'Authorization': fclass="hl-string">'Bearer {token}',
        class="hl-string">'x-api-key': API_KEY
    }

    all_activities = []
    limit = 100
    offset = 0
    
    while True:
        class=class="hl-string">"hl-comment"># 1. Fetch a page of quality events
        events_url = fclass="hl-string">"{BASE_URL}/api/v2/events?limit={limit}&offset={offset}&startDate={START_DATE}&endDate={END_DATE}"
        try:
            events_response = requests.get(events_url, headers=headers)
            events_response.raise_for_status()
            events_data = events_response.json().get(class="hl-string">'data', [])
        except requests.exceptions.RequestException as e:
            print(fclass="hl-string">"Error fetching events list: {e}")
            break

        if not events_data:
            break class=class="hl-string">"hl-comment"># Exit loop if no more events are returned

        for qe_summary in events_data:
            qe_id = qe_summary.get(class="hl-string">'id')
            if not qe_id:
                continue

            class=class="hl-string">"hl-comment"># 2. Fetch the detailed history for each quality event
            history_url = fclass="hl-string">"{BASE_URL}/api/v2/events/{qe_id}/history"
            try:
                history_response = requests.get(history_url, headers=headers)
                history_response.raise_for_status()
                history_data = history_response.json().get(class="hl-string">'data', [])
            except requests.exceptions.RequestException as e:
                print(fclass="hl-string">"Error fetching history for event {qe_id}: {e}")
                continue

            class=class="hl-string">"hl-comment"># 3. Map audit trail entries to activities
            for entry in history_data:
                activity = None
                activity_name = class="hl-string">""
                event_time = entry.get(class="hl-string">'timestamp')
                user_name = entry.get(class="hl-string">'user', {}).get(class="hl-string">'name')

                action = entry.get(class="hl-string">'action', class="hl-string">'').lower()
                field_name = entry.get(class="hl-string">'fieldName', class="hl-string">'').lower()
                new_value = entry.get(class="hl-string">'newValue', class="hl-string">'')
                
                class=class="hl-string">"hl-comment"># Mapping logic based on common MasterControl audit trail patterns
                if action == class="hl-string">'create' and entry.get(class="hl-string">'objectType') == class="hl-string">'QualityEvent':
                    activity_name = class="hl-string">'Quality Event Created'
                elif action == class="hl-string">'status_change' and new_value == class="hl-string">'Under Assessment':
                    activity_name = class="hl-string">'Initial Triage Completed'
                elif action == class="hl-string">'status_change' and new_value == class="hl-string">'Under Investigation':
                    activity_name = class="hl-string">'Investigation Initiated'
                elif action == class="hl-string">'task_complete' and class="hl-string">'root cause' in entry.get(class="hl-string">'taskName', class="hl-string">'').lower():
                    activity_name = class="hl-string">'Root Cause Analysis Performed'
                elif action == class="hl-string">'link' and class="hl-string">'capa' in entry.get(class="hl-string">'linkedObjectType', class="hl-string">'').lower():
                    activity_name = class="hl-string">'Corrective Action Plan Proposed'
                elif action == class="hl-string">'e_signature' and class="hl-string">'approve capa' in entry.get(class="hl-string">'reason', class="hl-string">'').lower():
                    activity_name = class="hl-string">'Corrective Action Plan Approved'
                elif action == class="hl-string">'task_complete' and class="hl-string">'implement corrective' in entry.get(class="hl-string">'taskName', class="hl-string">'').lower():
                    activity_name = class="hl-string">'Corrective Action Implemented'
                elif action == class="hl-string">'task_complete' and class="hl-string">'implement preventive' in entry.get(class="hl-string">'taskName', class="hl-string">'').lower():
                    activity_name = class="hl-string">'Preventive Action Implemented'
                elif action == class="hl-string">'task_complete' and class="hl-string">'effectiveness verification' in entry.get(class="hl-string">'taskName', class="hl-string">'').lower() and entry.get(class="hl-string">'taskResult') == class="hl-string">'Effective':
                    activity_name = class="hl-string">'Effectiveness of Action Verified'
                elif action == class="hl-string">'task_complete' and class="hl-string">'effectiveness verification' in entry.get(class="hl-string">'taskName', class="hl-string">'').lower() and entry.get(class="hl-string">'taskResult') == class="hl-string">'Ineffective':
                    activity_name = class="hl-string">'Effectiveness Deemed Ineffective'
                elif action == class="hl-string">'task_complete' and class="hl-string">'notify stakeholders' in entry.get(class="hl-string">'taskName', class="hl-string">'').lower():
                    activity_name = class="hl-string">'Stakeholders Notified'
                elif action == class="hl-string">'e_signature' and class="hl-string">'final review' in entry.get(class="hl-string">'reason', class="hl-string">'').lower():
                    activity_name = class="hl-string">'Final Review Conducted'
                elif action == class="hl-string">'status_change' and new_value == class="hl-string">'Closed':
                    activity_name = class="hl-string">'Quality Event Closed'
                elif action == class="hl-string">'status_change' and new_value == class="hl-string">'Cancelled':
                    activity_name = class="hl-string">'Quality Event Cancelled'

                if activity_name:
                    activity = {
                        class="hl-string">'QualityEvent': qe_id,
                        class="hl-string">'ActivityName': activity_name,
                        class="hl-string">'EventTime': event_time,
                        class="hl-string">'EndTime': event_time, class=class="hl-string">"hl-comment"># For atomic events, EndTime is the same as EventTime
                        class="hl-string">'UserName': user_name,
                        class="hl-string">'ResponsibleDepartment': qe_summary.get(class="hl-string">'department'),
                        class="hl-string">'QualityEventType': qe_summary.get(class="hl-string">'eventType'),
                        class="hl-string">'QualityEventStatus': new_value if class="hl-string">'status_change' in action else qe_summary.get(class="hl-string">'status'),
                        class="hl-string">'RootCauseCategory': qe_summary.get(class="hl-string">'rootCauseCategory'), class=class="hl-string">"hl-comment"># This might need to be sourced from a different field
                        class="hl-string">'EffectivenessStatus': entry.get(class="hl-string">'taskResult') if class="hl-string">'effectiveness' in activity_name else None,
                        class="hl-string">'TargetResolutionDate': qe_summary.get(class="hl-string">'targetDate')
                    }
                    all_activities.append(activity)

        offset += limit

    df = pd.DataFrame(all_activities)
    class=class="hl-string">"hl-comment"># Ensure datetime format is consistent
    df[class="hl-string">'EventTime'] = pd.to_datetime(df[class="hl-string">'EventTime']).dt.strftime(class="hl-string">'%Y-%m-%dT%H:%M:%S')
    df[class="hl-string">'EndTime'] = pd.to_datetime(df[class="hl-string">'EndTime']).dt.strftime(class="hl-string">'%Y-%m-%dT%H:%M:%S')
    return df

class=class="hl-string">"hl-comment"># --- Execution --- 
if __name__ == class="hl-string">"__main__":
    event_log_df = extract_quality_events()
    if not event_log_df.empty:
        event_log_df.to_csv(class="hl-string">"mastercontrol_quality_events_log.csv", index=False, encoding=class="hl-string">'utf-8-sig')
        print(fclass="hl-string">"Successfully extracted {len(event_log_df)} activities to mastercontrol_quality_events_log.csv")
    else:
        print(class="hl-string">"No data extracted.")

/*
This is a configuration guide for building the report in the MasterControl Analytics UI.
There is no executable SQL script, as the extraction is performed through the graphical interface.
Follow these steps in the report builder to configure your data extraction.
*/

**1. Report Data Source (Universe):**
Select a data source that combines Quality Event data with Audit Trail information. Example: `[Quality Events and Audit History]`

**2. Result Objects (Columns to Select):**

-- Case and Recommended Attributes
*   `InfoCard.ID` (as QualityEvent)
*   `InfoCard.Fields.[Quality Event Type]` (as QualityEventType)
*   `InfoCard.Fields.[Responsible Department]` (as ResponsibleDepartment)
*   `InfoCard.Fields.[Root Cause Category]` (as RootCauseCategory)
*   `InfoCard.Fields.[Effectiveness Status]` (as EffectivenessStatus)
*   `InfoCard.Fields.[Target Resolution Date]` (as TargetResolutionDate)
*   `InfoCard.Status` (as QualityEventStatus)

-- Required Activity Attributes
*   `Audit Trail.Record Type` or `Audit Trail.Action` (as ActivityName)
*   `Audit Trail.Date/Time` (as EventTime)
*   `Audit Trail.User Name` or `Audit Trail.Performed By` (as UserName)

**3. Query Filters (Filter Pane):**

*   **Filter 1: Date Range**
    *   Object: `Audit Trail.Date/Time`
    *   Operator: `Between`
    *   Values: `[Select a start date]` and `[Select an end date]`

*   **Filter 2: Activity Types**
    *   Object: `Audit Trail.Record Type`
    *   Operator: `In List`
    *   Values: Select all relevant system events. The exact names may vary in your configuration. You must map these technical names to the required business activity names post-export. Look for values similar to:
        *   `Create InfoCard` (maps to 'Quality Event Created')
        *   `Status Change` (used for 'Initial Triage Completed', 'Investigation Initiated', 'Quality Event Closed', 'Quality Event Cancelled')
        *   `Task Complete` (used for 'Root Cause Analysis Performed', 'Corrective Action Implemented', 'Preventive Action Implemented', 'Effectiveness of Action Verified', 'Stakeholders Notified')
        *   `Task Failed` (maps to 'Effectiveness Deemed Ineffective')
        *   `E-Signature Applied` (maps to 'Corrective Action Plan Approved', 'Final Review Conducted')
        *   `Link Created` (maps to 'Corrective Action Plan Proposed' when a CAPA is linked)

*   **Filter 3 (Optional): Quality Event Type**
    *   Object: `InfoCard.Fields.[Quality Event Type]`
    *   Operator: `In List`
    *   Values: `[Select desired event types, e.g., 'Non-conformance', 'Deviation']`

**4. Post-Export Transformation:**
After exporting to CSV, you must add a data transformation step to map the raw `Audit Trail.Record Type` and `InfoCard.Status` values to the standardized `ActivityName` values required by ProcessMind. For example, an audit record where `Record Type` is 'Status Change' and the new status is 'Closed' should be mapped to the `ActivityName` 'Quality Event Closed'.