Close Menu

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    A Century of Care and Craftsmanship: History of the Holy Kaaba’s Kiswa in the Saudi Era

    June 17, 2026

    AI infrastructure growth is rewriting rules of data centre design, says Equinix MENA MD 

    June 17, 2026

    New UAE rule may inspire more Emiratis to study medicine, join healthcare sector

    June 17, 2026
    Facebook X (Twitter) Instagram
    Riyadh Week
    • Home
    • KSA
    • Business
    • Technology
    • Sports
    • Lifestyle
    Facebook X (Twitter) Instagram YouTube
    Riyadh Week
    Home»Technology»Agentic AI demands stronger governance, human accountability, says MAST founder
    Technology

    Agentic AI demands stronger governance, human accountability, says MAST founder

    Editorial TeamBy Editorial TeamMay 26, 2026
    Share Facebook Twitter Pinterest Copy Link LinkedIn Tumblr Email
    Share
    Facebook Twitter LinkedIn Pinterest Email Copy Link

    Abhay Pandey, founder and CEO, MAST Consulting.

    Abhay Pandey explains why enterprises must embed compliance, cybersecurity, transparency, and human oversight into agentic AI systems to balance automation with trust, control, and regulatory alignment.

    Enterprises adopting agentic AI are entering a new phase of automation where AI systems are no longer limited to generating recommendations or content, but are increasingly capable of interacting with enterprise environments, triggering workflows, accessing systems, and making operational decisions autonomously.

    This shift is creating fresh challenges around governance, cybersecurity, compliance, accountability, and risk management, particularly in environments handling sensitive enterprise, financial, customer, or government data. Organisations are now under growing pressure to ensure that AI systems operate within clearly defined legal, ethical, and operational boundaries while remaining transparent, explainable, and auditable.

    Abhay Pandey, founder and CEO, MAST Consulting, shares insights into how businesses can securely deploy agentic AI while maintaining human oversight and organisational control. 

    Pandey discusses the importance of governance frameworks, Zero Trust principles, international standards such as ISO/IEC 42001, and risk-based human approval models in helping enterprises balance automation with accountability and regulatory compliance.

    Interview Excerpts

    How can organisations ensure that agentic AI systems operate within defined compliance, legal, and ethical boundaries, especially when they are capable of making autonomous decisions?
    Agentic AI should not enter the enterprise as an open-ended tool. It needs to be deployed within a defined operating model, where the system knows what it can do, what it cannot do, and when human approval is required. That means clear decision boundaries, approval hierarchies, access controls, audit trails, and risk thresholds before the first use case goes live.

    Compliance, legal, cybersecurity, and business teams need to review use cases together, because the risk is rarely technical alone. Fairness, privacy, transparency, and accountability should be built into the design process rather than added later.

    “Regular risk reviews, bias testing, monitoring, and alignment with standards such as ISO/IEC 42001 can help ensure AI remains useful without becoming uncontrolled.”

    What are the key cybersecurity, data privacy, and governance risks associated with deploying agentic AI in enterprise environments, and how can businesses mitigate them effectively?
    The important thing to remember is that agentic AI does not just produce content or recommendations. It can access systems, use data, call APIs, trigger workflows, and take actions across the enterprise. That changes the risk profile quite significantly. The main risks include data leakage, prompt injection, excessive access privileges, insecure integrations, biased outputs, and actions that may violate internal policy or regulation. A loosely defined AI agent flow can create operational risk very quickly, especially if it has access to sensitive systems.

    Businesses should treat agentic AI as part of their security and governance architecture. Zero Trust principles, strict identity and access management, encrypted data handling, API security, continuous monitoring, and human approval for high-risk actions are essential. Regular testing, adversarial simulations, privacy impact assessments, and model validation should also become part of the deployment lifecycle.

    In a typical workplace, which compliance-sensitive or security-critical tasks should never be fully delegated to agentic AI without human oversight?
    Any decision with legal, financial, ethical, regulatory, or reputational consequences should not be fully delegated to AI. This still includes many things, even at this stage of AI adoption – regulatory approvals, employee termination, legal interpretation, financial authorisation, fraud investigations, disciplinary actions, medical recommendations, and the handling of highly sensitive customer or government data.

    AI can still be useful in these areas. But the final decision should remain with qualified people who understand context, liability, and consequence.

    “AI can support the process, but it should not own the judgment where the outcome is sensitive, irreversible, or legally significant.”

    How should responsibilities and accountability be defined when an AI agent makes an incorrect, biased, or non-compliant decision?
    Organisations should be very clear on one point, which is that accountability does not move from people to the AI system. Agentic AI is still an enterprise tool, even if it can act with a degree of autonomy. Responsibility sits with the organisation, the business owners, and the teams that approved and deployed the system. This is especially important when AI agents are operating across multiple systems or departments.

    Every AI-driven action should be traceable through logs, decision records, approval workflows, and documented policies. There should also be a response process for AI failures, whether the issue is bias, inaccuracy, unauthorised action, or non-compliance. Vendor contracts can define certain obligations, but internal accountability cannot be outsourced.

    From a regulatory and audit perspective, how important are transparency, explainability, and traceability in agentic AI systems operating within enterprises?
    If an AI agent takes an action, the organisation must be able to explain what happened, what data was used, what control was in place, and who was responsible for the deployment. Regulators and auditors will increasingly expect organisations to demonstrate how AI decisions are made, what data was used, who approved deployments, and how risks are managed. Without traceability, organisations may struggle to investigate incidents, justify decisions, or prove compliance during audits. 

    “Enterprises should maintain detailed logs, model documentation, decision histories, and governance records. Transparent AI operations will strengthen trust among customers, regulators, and stakeholders while supporting accountability and responsible use of autonomous systems.”

    What role will international standards and frameworks such as ISO/IEC 42001, AI governance frameworks, and data protection regulations play in shaping responsible adoption of agentic AI?
    Standards like the ISO/IEC 42001 help businesses define how AI should be governed, monitored, reviewed, and improved over time. Data protection laws such as GDPR and regional privacy regulations are equally important because agentic AI will often interact with personal, financial, operational, or customer data. 

    Early alignment with recognised standards will help businesses build trust with customers, regulators, boards, and partners. Putting these systems in place early will be a competitive advantage at this point of the enterprise AI journey because it positions organisations to scale AI without constantly reacting to risk.

    How can businesses balance automation and efficiency gains from agentic AI while still maintaining human judgment, accountability, and decision-making authority?
    The right approach is a human-led, AI-assisted model. Agentic AI is well suited to repetitive analysis, data correlation, workflow orchestration, monitoring, reporting, and operational support. Human beings should continue to own strategic, ethical, financial, legal, and regulatory decisions.

    One model that could help with this is risk classification – low-risk tasks can be automated with monitoring, medium-risk tasks may require review, and high-risk tasks should require explicit human approval. Right now, this is the surest way to gain speed and efficiency without losing control. Clear escalation paths, governance structures, access controls, and regular performance reviews are important.

    “The goal should be to expand human capability, not remove human responsibility from decisions that require judgment.”

    What could a real-world enterprise environment look like where agentic AI is securely integrated into operations while remaining compliant, auditable, and aligned with organisational policies?
    In a mature enterprise environment, agentic AI operates within tightly governed boundaries integrated across business, cybersecurity, compliance, and IT operations. AI agents may assist with customer support, risk analysis, compliance monitoring, threat detection, workflow automation, and reporting, while all critical decisions require human approval. Every AI action is logged, monitored, and traceable through centralised governance dashboards. 

    Access to sensitive systems is controlled through Zero Trust principles and role-based permissions. Policies, standards, and risk controls are embedded into AI workflows from the design stage itself. Regular audits, model reviews, and compliance assessments ensure the AI ecosystem remains secure, transparent, accountable, and aligned with organizational and regulatory expectations.

     


    Source: Tahawul Tech

    Related Posts

    AI infrastructure growth is rewriting rules of data centre design, says Equinix MENA MD 

    June 17, 2026

    Dubai Chamber supports launch of 32 Apps via Create Apps Accelerator Programme

    June 17, 2026

    Cisco reports on AI network pressures

    June 17, 2026
    Top Posts

    QBS Software Middle East embeds AI into core operations

    April 1, 2026

    Bosnia’s Barbarez cool as ice after reaching World Cup in shootout with Italy

    April 1, 2026

    Kuwaiti tanker hit by Iranian drone attack in Dubai waters

    April 1, 2026

    UAE designers turn jewellery into meaningful Eid gifts

    April 1, 2026
    Don't Miss

    A Century of Care and Craftsmanship: History of the Holy Kaaba’s Kiswa in the Saudi Era

    By Editorial TeamJune 17, 2026

    For more than a century, the Holy Kaaba’s Kiswa has been one of the most…

    AI infrastructure growth is rewriting rules of data centre design, says Equinix MENA MD 

    June 17, 2026

    New UAE rule may inspire more Emiratis to study medicine, join healthcare sector

    June 17, 2026

    Al-Harth Municipality Walkway Emerges as Tourist Destination Showcasing Jazan’s Mountain Beauty

    June 17, 2026
    • KSA
    • Business
    • Technology
    • Lifestyle
    • Sports
    2026. All rights reserved.

    Type above and press Enter to search. Press Esc to cancel.