{"id":31058,"date":"2025-06-21T17:40:07","date_gmt":"2025-06-21T17:40:07","guid":{"rendered":""},"modified":"-0001-11-30T00:00:00","modified_gmt":"-0001-11-30T00:00:00","slug":"the-role-of-human-oversight-in-ai-driven-utilization-review-insights-from-california-s-legislation-1985347","status":"publish","type":"post","link":"https:\/\/www.simbo.ai\/blog\/the-role-of-human-oversight-in-ai-driven-utilization-review-insights-from-california-s-legislation-1985347\/","title":{"rendered":"The Role of Human Oversight in AI-Driven Utilization Review: Insights from California’s Legislation"},"content":{"rendered":"

Artificial intelligence (AI) is being used more often in healthcare. It helps in utilization review (UR) and utilization management (UM). Utilization review checks if a patient\u2019s healthcare services are necessary and right. Utilization management handles these services, like approvals, changes, or denials of care requests. With AI getting better, many healthcare groups and health plans use automated systems to speed up reviews and cut down on paperwork. However, some people worry that AI might not fairly or correctly judge complex patient needs without a human involved.<\/p>\n

This article looks at new laws in California about using AI in utilization review and management. It focuses on why human oversight, clear communication, and patient safety are important. The information is useful for medical office leaders, clinic owners, and IT managers across the U.S. who are seeing more AI in daily healthcare work.<\/p>\n

California\u2019s Senate Bill 1120: Human Oversight in AI Utilization Review<\/h2>\n

California Governor Gavin Newsom signed Senate Bill 1120 (SB 1120), also called the Physicians Make Decisions Act, on September 28, 2024. The law started on January 1, 2025. It controls how AI and computer programs are used in utilization review and management by health plans and disability insurers in California.<\/p>\n

SB 1120 was made because people were worried about AI making decisions about medical needs without careful human review. The law says AI decisions must be based on a patient\u2019s own clinical data and history, not just general or group data. Licensed healthcare providers like doctors or health professionals must have the final say on approving, changing, or denying care. They must use their clinical judgment, which AI cannot replace.<\/p>\n

The California Department of Managed Health Care (DMHC) and Department of Insurance (DOI) make sure the law is followed. They check that AI systems are fair, accurate, reliable, and protect patient privacy. Breaking the law can cause fines. This shows California\u2019s effort to protect patients from wrong denials caused by bad or biased AI decisions.<\/p>\n

Transparency and Patient Communication: Assembly Bill 3030<\/h2>\n

Along with SB 1120, California passed Assembly Bill 3030 (AB 3030). This law says healthcare providers must tell patients when AI creates messages that include health information. The goal is to make communication clear so patients know some messages are made using AI.<\/p>\n

AB 3030 requires all AI-generated clinical messages sent to patients to have a clear note explaining AI was used. The messages must also tell patients how to contact a licensed healthcare professional if they have questions or worries. The only exception is if a licensed provider checks and approves the AI message before it is sent. Then, the AI note can be left out.<\/p>\n

Medical practice leaders and IT managers need to update communication rules and computer systems to follow this law. Training staff to answer patient questions about AI use is also important.<\/p>\n

Balancing Efficiency and Patient Safety with AI in Utilization Management<\/h2>\n

SB 1120 recognizes that AI can help make utilization reviews faster, especially since healthcare has more paperwork than before. AI can speed up approvals. But the law says AI should help human decision-makers, not replace them.<\/p>\n

One worry from healthcare groups, like the California Hospital Association, is that AI does not fully understand each patient\u2019s unique needs. For example, AI might see that most people need no special treatment for a condition. But it might miss rare problems, patient wishes, or social factors that affect care.<\/p>\n

Jennifer Rangel from the California Hospital Association said SB 1120 tries to balance working quickly in healthcare with keeping patients safe and getting quality care. John T. Vaughan said that because humans must review final decisions, the time saved by AI might be less than expected and cause workflow problems.<\/p>\n

This means healthcare workers should create systems where AI does first checks but does not slow down important clinical reviews. Combining these steps well can improve speed without hurting care.<\/p>\n

<\/p>\n

\n
\u2713<\/div>\n
\n

After-hours On-call Holiday Mode Automation<\/h4>\n

SimboConnect AI Phone Agent auto-switches to after-hours workflows during closures.<\/p>\n

Start Your Journey Today <\/a>\n <\/div>\n<\/div>\n

<\/p>\n

Federal and State Regulations Beyond California<\/h2>\n

California is part of a wider trend in the U.S. The Biden administration\u2019s Executive Order from October 2023 told the Department of Health and Human Services (HHS) to make a plan for using AI in healthcare. This plan stresses following privacy laws like HIPAA and making sure AI decisions about medical needs look at individual patient conditions.<\/p>\n

The Medicare Advantage Policy Rule, effective April 2023, also stops Medicare Advantage groups from only using AI for coverage decisions. They must have qualified healthcare workers review all decisions based on each patient\u2019s situation. Decisions must be fair and patients can question them if needed.<\/p>\n

Other states, like Colorado, have made laws to protect people from unfair AI use. Colorado\u2019s law requires checks on how AI affects consumers and says companies must be open about using AI.<\/p>\n

Illinois requires that bad decisions in utilization management be reviewed by clinical peers, supporting the need for human review in AI processes.<\/p>\n

Healthcare leaders across the country should expect similar laws and adjust their systems in time.<\/p>\n

<\/p>\n

\n

HIPAA-Compliant Voice AI Agents<\/h4>\n

SimboConnect AI Phone Agent encrypts every call end-to-end – zero compliance worries.<\/p>\n

Claim Your Free Demo \u2192<\/a>\n<\/div>\n

<\/p>\n

The Role of AI and Workflow Automation in Utilization Review<\/h2>\n

Although laws require human review, AI and automation help medical offices reduce paperwork and improve communication.<\/p>\n

AI can help front desks by answering phones, setting up appointments, handling prescription refills, and doing patient screening. For example, Simbo AI offers phone automation that handles routine patient calls well. This frees up staff to focus on clinical and difficult questions.<\/p>\n

In utilization review, AI can quickly look at patient records, point out cases needing human review, or find missing info to speed decisions. Automation can send these cases to the right clinical reviewers, track deadlines for prior authorization, and remind people about what still needs doing.<\/p>\n

But workflows must join AI suggestions with provider reviews carefully. The human reviewer should get clear reports from AI and be able to change or reject AI decisions using clinical knowledge.<\/p>\n

IT managers at medical offices need to make sure automation follows rules, like keeping logs of AI use and safely storing messages to meet HIPAA. Transparency should reach healthcare teams too, with training on how to understand AI results and what to do when AI flags unusual cases.<\/p>\n

<\/p>\n

\n

Voice AI Agents Takes Refills Automatically<\/h4>\n

SimboConnect AI Phone Agent takes prescription requests from patients instantly.<\/p>\n

\n
\n Claim Your Free Demo \u2192<\/a>\n <\/div>\n<\/div>\n

<\/p>\n

Challenges and Practical Considerations for Healthcare Providers<\/h2>\n
    \n
  • \n

    Updating Policies and Procedures:<\/b> Healthcare groups need to change internal rules to include human checks of AI decisions and rules for telling patients about AI messages.<\/p>\n<\/li>\n

  • \n

    Training Staff:<\/b> Everyone involved in utilization management, patient communication, and admin work must learn about new laws and what they need to do.<\/p>\n<\/li>\n

  • \n

    Compliance and Audits:<\/b> Healthcare groups must keep detailed records showing they follow SB 1120\u2019s rules for oversight and transparency. They should get ready for checks by officials like the DMHC.<\/p>\n<\/li>\n

  • \n

    Upgrading Technology:<\/b> IT systems must track AI decision steps and add disclaimers automatically on patient messages, as AB 3030 requires.<\/p>\n<\/li>\n

  • \n

    Balancing Speed and Oversight:<\/b> AI can speed up tasks, but keeping clinical care fair and accurate means humans must review without blocking work.<\/p>\n<\/li>\n<\/ul>\n

    Impact on Patient Trust and Care Quality<\/h2>\n

    AB 3030\u2019s rule to put notes on AI messages affects how patients see their care. Some patients might wonder if AI-made messages are less reliable or personal. On the other hand, being open about AI use can help patients feel safer because controls are in place.<\/p>\n

    Medical practice leaders should explain clearly how AI is used and how humans stay involved in care decisions. Letting patients talk to licensed professionals if they have questions helps keep trust and satisfaction.<\/p>\n

    Legislative Trends and Future Outlook<\/h2>\n

    Governor Newsom vetoed a stricter bill called Senate Bill 1047, which aimed to regulate AI models harder. This shows California wants a balanced approach that supports AI development but also protects patients with good oversight instead of too many limits.<\/p>\n

    California\u2019s approach might guide other states as they think about AI rules in healthcare. As technology keeps growing fast, federal agencies and lawmakers will likely work together to make more consistent AI rules across the country.<\/p>\n

    Healthcare people, especially those handling utilization review and patient communication, should keep up with changing laws. Working together with regulators, healthcare providers, tech developers, and patient groups will be necessary to create and follow good practices.<\/p>\n

    Human Clinical Judgment and AI in Healthcare<\/h2>\n

    California\u2019s laws, especially SB 1120 and AB 3030, show that human clinical judgment is very important when AI is used in healthcare. They reflect the understanding that AI can help make utilization review faster and based on data. But human oversight is needed to make sure care is fair, safe, and fits each patient\u2019s needs.<\/p>\n

    For medical office leaders, owners, and IT managers in the U.S., the lessons from California\u2019s laws show how to combine AI tools with expert human review. Clear patient communication and strong workflows will help healthcare groups meet legal rules and patient needs.<\/p>\n

    About Simbo AI and AI Workflow Automation<\/h2>\n

    Simbo AI focuses on front-office AI automation. It offers phone answering services to help medical offices handle patient calls well and follow new AI-related laws. Simbo AI\u2019s tools let healthcare providers automate routine communications, bring in humans where needed, and keep patient privacy laws like HIPAA.<\/p>\n

    Using AI workflow automation like Simbo AI\u2019s technology helps medical offices manage utilization reviews and patient communication better while keeping the human checks that laws require. This can improve staff work, lower costs, and make patient experiences better.<\/p>\n

    Healthcare leaders using these AI tools should make sure settings allow quick human reviews and keep clear records. Balancing automation and clinical checks matches California\u2019s laws and can serve as a model for other states planning similar rules.<\/p>\n

    \n

    Frequently Asked Questions<\/h2>\n
    \n
    \nWhat is California’s recent legislation regarding AI in healthcare?<\/summary>\n
    \n

    California recently enacted two key bills: SB 1120, regulating AI use in utilization review (UR) processes, and AB 3030, which mandates disclosure of AI-generated patient communications. These aim to ensure patient safety while promoting efficiency. SB 1120 requires human oversight in UR determinations, while AB 3030 demands clear disclaimers when generative AI is used in patient communications.<\/p>\n<\/p><\/div>\n<\/details>\n

    \nWhat are the requirements set by SB 1120 for AI in utilization review?<\/summary>\n
    \n

    SB 1120 mandates that UR decisions must be based on relevant clinical criteria, with human healthcare providers as the ultimate decision-makers. AI must enhance but not replace clinical judgment, and the technology must be regularly reviewed for accuracy and reliability.<\/p>\n<\/p><\/div>\n<\/details>\n

    \nWhat does AB 3030 require for patient communications involving AI?<\/summary>\n
    \n

    AB 3030 requires that any clinical information communicated via generative AI includes a disclaimer noting the AI-generated nature of the content. It also mandates clear instructions for patients on how to contact the healthcare provider for further inquiries.<\/p>\n<\/p><\/div>\n<\/details>\n

    \nIs there an exception to the AI disclosure requirements of AB 3030?<\/summary>\n
    \n

    Yes, the exception applies if the AI-generated communication is reviewed by a licensed or certified healthcare provider before being sent to the patient. In such cases, the disclosure may not be necessary.<\/p>\n<\/p><\/div>\n<\/details>\n

    \nWhat was the outcome of SB 1047?<\/summary>\n
    \n

    SB 1047, which aimed for stricter oversight of AI usage, was vetoed by Governor Newsom. He considered its requirements overly stringent, emphasizing that it did not account for the context in which AI systems are used.<\/p>\n<\/p><\/div>\n<\/details>\n

    \nHow will SB 1120 and AB 3030 impact healthcare providers?<\/summary>\n
    \n

    Both bills impose new legal obligations on healthcare providers, requiring them to disclose AI usage and ensure human oversight in patient care decisions and communications, thereby potentially changing how they interact with patients and process claims.<\/p>\n<\/p><\/div>\n<\/details>\n

    \nWhat does the veto of SB 1047 imply about the future of AI regulation in California?<\/summary>\n
    \n

    The veto indicates a cautious approach to regulation, suggesting that while there is potential for more laws, they may be less stringent than SB 1047. California may seek national standards for AI regulation instead.<\/p>\n<\/p><\/div>\n<\/details>\n

    \nWhat challenges might healthcare providers face with the new regulations?<\/summary>\n
    \n

    Healthcare providers may face challenges including the need to adapt their communication policies to comply with new disclosure requirements and balancing the efficient use of AI technologies while meeting the mandate for human involvement.<\/p>\n<\/p><\/div>\n<\/details>\n

    \nHow might patient perceptions change due to AB 3030?<\/summary>\n
    \n

    The requirement for disclaimers in AI-generated communications may impact patient trust and their choice of healthcare providers. Patients may weigh the implications of receiving AI-generated information differently than traditionally communicated information.<\/p>\n<\/p><\/div>\n<\/details>\n

    \nWhat is the overarching goal of California’s AI healthcare regulations?<\/summary>\n
    \n

    The overarching goal is to enhance patient safety and care quality while ensuring that AI technologies are used responsibly and transparently. The legislation aims to blend innovation with necessary oversight to protect patients.<\/p>\n<\/p><\/div>\n<\/details><\/div>\n<\/section>\n","protected":false},"excerpt":{"rendered":"

    Artificial intelligence (AI) is being used more often in healthcare. It helps in utilization review (UR) and utilization management (UM). Utilization review checks if a patient\u2019s healthcare services are necessary and right. Utilization management handles these services, like approvals, changes, or denials of care requests. With AI getting better, many healthcare groups and health plans […]<\/p>\n","protected":false},"author":6,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[],"tags":[],"class_list":["post-31058","post","type-post","status-publish","format-standard","hentry"],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.simbo.ai\/blog\/wp-json\/wp\/v2\/posts\/31058","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.simbo.ai\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.simbo.ai\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.simbo.ai\/blog\/wp-json\/wp\/v2\/users\/6"}],"replies":[{"embeddable":true,"href":"https:\/\/www.simbo.ai\/blog\/wp-json\/wp\/v2\/comments?post=31058"}],"version-history":[{"count":0,"href":"https:\/\/www.simbo.ai\/blog\/wp-json\/wp\/v2\/posts\/31058\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.simbo.ai\/blog\/wp-json\/wp\/v2\/media?parent=31058"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.simbo.ai\/blog\/wp-json\/wp\/v2\/categories?post=31058"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.simbo.ai\/blog\/wp-json\/wp\/v2\/tags?post=31058"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}