When AI Starts Making Decisions: Should We Trust It? | Afternoon Coffee with Srini & Ariyan

Afternoon Coffee with Srini & Ariyan

There was a time when we used AI mainly to get answers.

We asked a question.

AI gave us an answer.

Simple.

But something is changing.

AI is slowly moving from simply answering questions to helping make decisions, recommending actions, and in some cases, taking actions on our behalf.

And that made me stop for a moment.

Srini: “Ariyan, if AI is no longer just giving answers but is starting to make decisions on its own… should we really trust it?”

Ariyan: “Trust? Or verification? Maybe the real question is: how much decision-making power are we actually ready to give AI?”

That question sounds simple.

But the more you think about it, the more complicated it becomes.

🤖 AI Is No Longer Just an Answer Machine

Modern AI systems can do much more than generate text.

They can analyse information, compare options, recommend actions, use tools, and work through multiple steps to complete a task.

This is where AI agents become especially interesting.

An AI agent may receive a goal and then decide what steps are necessary to reach that goal.

That is very different from simply asking ChatGPT a question and receiving an answer.

The AI is no longer just responding.

It is participating in a process.

🧠 But What Exactly Is a Decision?

Let's take a simple example.

Imagine you ask an AI assistant:

That sounds harmless.

But what happens next?

Should the AI choose the cheapest flight?

What if the cheapest flight has three stops?

What if another flight costs slightly more but saves six hours?

What if the cheaper airline has poor cancellation policies?

Suddenly, the AI isn't simply searching.

It has to decide what “best” actually means.

And that's where human preferences become extremely important.

⚖️ Small Decisions Are Different From Big Decisions

Not every AI decision has the same level of risk.

If AI recommends which movie you should watch tonight, a mistake doesn't matter much.

But imagine an AI system helping decide:

• Which medical treatment should be considered
• Whether a financial transaction should be approved
• Whether someone qualifies for a loan
• Which job candidate should be shortlisted
• Whether a security alert represents a real threat

Now the situation becomes very different.

The consequences of a wrong decision can affect someone's life.

That's why the question shouldn't simply be:

“Can AI make the decision?”

We should also ask:

“Should AI be allowed to make that decision by itself?”

😳 And Then I Asked Ariyan Something

Srini: “Ariyan, if AI becomes better at analysing information than humans, why shouldn't we just let AI make the decision?”

Ariyan: “Because being better at analysing information doesn't automatically mean being responsible for the consequences.”

I paused for a second.

That actually makes a lot of sense.

An AI might calculate thousands of possibilities in seconds.

It might identify patterns that humans miss.

It might even make statistically better predictions.

But who decides what outcome is acceptable?

That's not always a mathematical question.

Sometimes it's a human question.

⚠️ What Happens When AI Makes the Wrong Decision?

This is where things become uncomfortable.

Suppose an AI agent makes a decision that causes a serious problem.

Who is responsible?

The developer?

The company that deployed the system?

The person who gave the AI permission to act?

Or the person who trusted the AI without checking its decision?

There may not always be a simple answer.

And as AI agents become more autonomous, this question will become increasingly important.

👤 Human Oversight May Become More Important, Not Less

It might sound strange, but more powerful AI could actually make human oversight more important.

If AI is only generating a simple answer, checking it may be relatively easy.

But if an AI agent can plan, use tools, interact with systems, and take actions, the consequences of an error become much larger.

That means we may need systems where humans can:

• Review important decisions
• Set limits on what AI can do
• Approve high-risk actions
• Monitor autonomous processes
• Stop an AI system when something looks wrong

In other words, autonomy doesn't have to mean complete independence.

🔍 AI Can Be Confident and Still Be Wrong

There is another problem we shouldn't forget.

AI can sometimes produce an answer with a lot of confidence even when the answer is incorrect.

That becomes more dangerous when the system is allowed to act on its own.

A wrong answer in a conversation can be corrected.

A wrong action in the real world may be much harder to undo.

That's why verification matters.

AI confidence is not the same thing as AI correctness.

🌍 What Will the Future Look Like?

I don't think the future will simply be humans versus AI.

It may be more complicated than that.

We may end up with a world where humans and AI work together.

AI handles large amounts of information.

AI explores possibilities.

AI identifies patterns.

AI recommends actions.

And humans decide where the final responsibility should remain.

That could actually be a much more powerful model.

☕ Maybe Trust Isn't the Right Word

Srini: “So should we trust AI?”

Ariyan: “Maybe the better question is: How should we verify AI?”

That answer stayed with me.

Because trust doesn't have to mean blindly accepting everything.

We trust airplanes, but we still have safety systems.

We trust doctors, but medical decisions are based on evidence and testing.

We trust computers, but critical systems still have backups and security controls.

Maybe AI should be treated the same way.

Powerful enough to help.

But controlled enough to remain accountable.

🌅 The Real Challenge Isn't Making AI Smarter

AI will probably continue becoming more capable.

It will understand more information.

It will use more tools.

It will handle more complicated tasks.

And eventually, some AI systems may make decisions that currently require several human steps.

But perhaps the real challenge isn't creating AI that can make better decisions.

Perhaps the real challenge is creating a system where humans know:

When should AI decide?

When should AI recommend?

And when should AI stop and ask a human?

☕ Afternoon Coffee Thought

Srini: “Ariyan, maybe the future isn't about letting AI make every decision.”

Ariyan: “Maybe it's about knowing which decisions AI should never make alone.”

And maybe that's the balance we need.

We don't have to fear every decision made by AI.

But we also shouldn't hand over important decisions simply because a machine can process information faster than us.

The future of AI may not be about choosing between humans and machines.

It may be about learning how to make better decisions together.

Because the smarter AI becomes, the more important one thing may become:

Knowing when to trust it — and knowing when to question it.

☕ Until the next Afternoon Coffee — Srini & Ariyan

Keep thinking. Keep questioning. And never stop learning.

📚 Further Reading

For readers who want to explore AI agents, autonomous systems, and AI decision-making further, you can also read related articles on Glaze4You:

• Can We Really Control Autonomous AI Agents? 
• When AI Stops Just Answering and Starts Acting
• If AI Can Independently Plan, Execute and Act, Who Is Responsible?