DKDKCISSP
← Cybersecurity on the GroundCHALLENGE

“You Run the Servers, So You Patch Them”

By Deepak Kumar, CISSP

The problem: Security wants all 120 servers patched every month. A patch is a small update that closes a known weakness. Security says, “You run the servers, so patching is your job.” IT says, “Security wants it, so security must give us the time and the budget. We also take the blame when a patch breaks something.” The patch cycle slips from monthly to quarterly.

Words used here: a service provider is a team that does work for others, such as IT running servers for the business. A service agreement is a short written deal about what work is done, how often and by when. A patch window is the planned time when servers can be updated and restarted.

Think of a chirping smoke alarm

A smoke alarm in a rented flat starts to chirp, because the battery is low. The landlord says, “The alarm is inside your home, so you change the battery.” The tenant says, “The alarm belongs to the building, so you pay and fix it.” Both have a point. The alarm keeps chirping. Nobody has agreed who climbs the ladder.

The chirping smoke alarm
A smoke alarm, chirping
It is in your home. You fix it.
Landlord
It is your building. You pay.
Tenant
The alarm is real. Nobody agreed who climbs the ladder.

What it looks like at work

A scan shows that 90 of the 120 servers are more than 60 days behind on patches. Security asks IT to patch all servers every month. IT replies that patching is a security task. Security replies that IT runs the servers. IT says that patching needs night work, testing, and a restart of services, and no extra people. It also says that if a patch breaks an application, IT gets the blame, and security does not. Both teams send emails. The patch cycle moves to quarterly, quietly.

How monthly patching becomes a tussle
  1. 11. Security asksPatch all 120 servers monthly.
  2. 22. IT repliesPatching is a security task.
  3. 33. Security saysYou run the servers. Do it.
  4. 44. IT saysNo time, no budget, and we take blame.
  5. 55. ResultPatches slip to every quarter.
Each team is right about its own side. Nobody wrote the deal.

Both sides are half right. Security is right that known weaknesses must be closed on time, because attackers use them quickly. IT is right that patching takes people and planned time, and that outages caused by patches land on IT. What is missing is a written service agreement: who does what, how often, how many hours, who pays, and what happens if a patch breaks something.

You will notice it when:

  • The words “not our job” appear in emails between the two teams.
  • The patch cycle has no written schedule.
  • Nobody knows how many hours a month patching takes.
  • When a patch breaks something, nobody is sure who explains it to the business.
  • Patch numbers are different in IT’s report and in security’s scan.

What exactly needs fixing

The first fix is not the patching. It is the agreement about the patching. This card shows the whole problem on one page:

Nobody agreed who runs and pays for monthly patching
WHAT IS BROKEN

Security expects IT to patch 120 servers monthly. IT says it is not its job, and the work is slipping.

WHERE IT IS

The monthly patch cycle for 120 servers, between two teams.

WHAT COULD GO WRONG

Known weaknesses stay open for months on many servers.

WHAT IT COSTS US
  • Open weaknesses
  • Stalled work
  • Blame game
  • Audit finding
THE FIX, IN THREE MOVES
  1. 1
    1. Write the service
  2. 2
    2. Agree cost, time
  3. 3
    3. Report monthly
WHO FIXES IT

Who fixes it: IT head, security head

BY WHEN

By when: agreement in 4 weeks

A blank copy of this card is in the Tools section.

Why it happens

  • The two teams see the work from opposite sides. Security sees risk. IT sees workload and outages.
  • Nobody wrote the deal. So each team uses its own picture of it.
  • The cost sits with IT. The benefit sits with security and the business.
  • Blame is uneven. An outage after a patch is visible. A breach through an unpatched server is later, and invisible.
  • There is no agreed target. “Monthly” was never signed by both.
  • Capacity is not counted. The hours for patching are not in anyone’s plan.

What happens if you ignore it

Known weaknesses stay open, while both teams argue about whose job it is.

  • An attacker uses a weakness that has had a fix available for months.
  • The patch cycle slips again each quarter, and nobody decides it.
  • The relationship between IT and security gets worse, and spreads to other topics.
  • An audit finds old patches, and each team points at the other.

At a glance

QuestionAnswer
How likely is it to hurt us?Very likely. Late patching is one of the most common causes of break-ins.
Worst case?A break-in through a weakness with a fix that was available for months.
What does it cost?A breach clean-up, a failed audit, and a broken working relationship.
What if we wait?The cycle slips more, and the arguments get older and sharper.
What does the fix cost?A few meetings, a one-page agreement, and a number for the hours.

How to fix it, step by step

Write the deal, count the cost, and report the same numbers to both teams every month.

  1. Stop arguing about whose job it is. Say, “We both need this done. Let us agree how.”
  2. Write the service on one page. What is patched, how often, in which time window, and within how many days of a critical fix being released.
  3. Split the roles. Security sets the target and checks the result. IT plans the work and does it.
  4. Count the hours. How many hours a month does patching really take for 120 servers? Include testing and restarts.
  5. Agree who pays. If it is more work than IT can do, then security, or the business, funds extra hands, or the target is relaxed in writing.
  6. Agree what happens when a patch breaks something. A rollback plan, who explains it to the business, and that it is a shared risk, not IT’s fault alone.
  7. Use patch windows. A fixed monthly night, announced in advance, so the business expects the restart.
  8. Report the same numbers. One monthly report, from one source, that both teams read. “110 of 120 servers within 30 days.”
Agree the service in writing
1. Write the serviceWhat, how often, and in which time window.
2. Agree cost and timeHours a month, who pays, who sets the priority.
3. Report monthlyBoth teams see the same numbers each month.
Security sets the target. IT plans the work. Both sign.

The picture shows the three parts: write the service, agree cost and time, and report each month.

Who to bring in: The IT lead (who plans and does the work), the security lead (who sets the target and checks it), a budget owner, and a business owner for the servers (who agrees the patch window).

Tools and templates

One-page patch service agreement (example)

ItemWhat to agree
ScopeWhich servers: all 120, or the critical ones first
TargetCritical fixes within 7 days, others within 30 days (set your own)
Patch windowSecond Saturday of the month, 10 pm to 2 am
Hours neededAgreed number per month
Who paysBudget owner named
If a patch breaks somethingRollback within 1 hour, and a shared note to the business
ReportOne monthly report, same numbers for both teams

Blank finding card

FieldWrite here
What is brokenOne line, in plain words
Where it isThe system, team, or process
What could go wrongIn one sentence
What it costs usMoney, time, a leak, lost trust
The fixThe exact action
Who fixes itOne name or one team
By whenA date, not “soon”

Email to the IT lead

Subject: Writing down how we patch the servers

Hi [name]. I think we are both right and we have never written it down. Security needs known weaknesses closed on time. IT needs people, time, and a fair share of the blame when a patch breaks something. Could we meet for 30 minutes and write a one-page agreement? It would cover what is patched, how often, the monthly window, the hours it takes, and who explains it if something goes wrong. I will bring the scan numbers and you bring the hours.

Field tip

Do not say, “This is your job.” Say, “Here is what we both need, and here is what each of us does.” The first starts an argument. The second starts a deal.

Words used in this chapter

  • Patch: a small update that closes a known weakness.
  • Service provider: a team that does work for others, such as IT running servers for the business.
  • Service agreement: a short written deal about what work is done, how often and by when.
  • Patch window: the planned time when servers can be updated and restarted.
  • Rollback: undoing a change to get back to how things were before.