By Gregory Hale
Nine years ago, one manufacturing facility for chemical giant LyondellBasell fell victim to a Conficker virus attack that had already been out for four years which ended up shutting down some firewalls but ultimately did not shut down the plant.

“This was a known virus and there were known fixes, but we were not prepared for it,” said Michael Norris, director of business systems security at LyondellBasell during a session entitled “Building & Maturing IT/OT Risk Management: An Ongoing Journey” Tuesday at the PAS Optics 2020 virtual conference. “This virus spread out through our Level 3 systems, but we were fortunate it did not shut down our DCS. It did shut down our firewall. We had a firewall separating OT from our IT. It shut it down because there was so much traffic going through it because all these devices were trying to get back to its host.

“We lost a lot of systems on Level 3 including all our advanced process control and all of our process monitoring systems, but we did not have to shut the plant down. It took us about three days to clean the system up and get back to the way it was.”

That is when the company said, that is it, we need to become secure.

Schneider Bold

Security Plan Begins
“We found the virus came in through a jump drive brought in by a vendor, Norris said. “All of our systems on Level 3 and Level 2 were unpatched, which was a real issue. Also, our virus definitions were not up to date. At this point we recognized we had issues on our OT side that needed to be fixed. What this event did is it led us to centralizing our cybersecurity management. Essentially to this point IT operated on their own and OT operated on its own and there was no collaboration between the two. What this did was it put the focus on cybersecurity on both sides of the firewall and led us to accountability moving into a centralized location. We started a program to standardize our architecture. We did a survey that found several sites had firewalls in place, but they were operating as switches because our firewall rules were not up to date, we didn’t have secure remote access, our patching was not being done and we had little or no monitoring so we really didn’t know where we were at.

“So, we started from there with a yearly program to make incremental investments in our architecture. This went on for four years where we went out and started fixing things. Through this we ended up with network segmentation, centralized server updates which included patching and antivirus, secure remote access and we began monitoring. Up to this point we were not monitoring on the OT side. We started measuring KPIs. We developed a set of KPIs that were consistent with security on the OT side.”

When they first started measuring KPIs, they were not in a good spot.

“We were looking at some plants that had little or no patches,” Norris said. “Over the past five years, we have made significant progress. We are still not where we want to be. Also, in 2012, we looked to standardize on ISO27001. This allowed us to put standards and polices in place for cybersecurity on the IT side. This also helped us to develop and normalize our OT standards. We did not have a standard in place that had minimum requirements for the OT side. In 2016, we got that standard in place.”

Centralized IT-OT Security
In addition, LyondellBasell centralized the architecture and operations for IT and OT where all architectures go through a centralized group.

“This all came from a third-party assessment that identified we had a lack of expertise and focus out on our sites,” Norris said. “We have a lot of gaps on the OT side as far as cyber security goes. We have a lot of obsolete devices that need to be fixed. We really needed to increase the focus.”

One reason why they focused on their OT security was because as a company LyondellBasell is moving toward digital transformation where they are trying to use more data from the OT side to drive value. “To do that, the OT side needs to be secure,” Norris said.

The next step is tightening security on the OT side

“We have an OT standard and part of that requires to have an up to date asset inventory,” Norris said. “What we are finding is when we do audits, most sites don’t meet this requirement. It is partially because it is difficult to do without and automated system. They are currently doing asset inventory on spread sheets and they are not maintained very well. Without an up to date inventory, when we have a security alert, it takes a while to react to it. It can take up to four weeks for us to respond to it. We are not comfortable with that.

“We also have another gap and that is back-ups for configuration,” Norris said. “We do them, but there are done infrequently. We are worried about a malicious insider coming in and screwing some things up. It would take an enormous amount of engineering to rebuild our configurations in some of our plants. We don’t have complete monitoring. It comes through about once a day and that is not frequent enough. Change management is not consistent with industry standards and each site has its own process.”

Change in the Air
Once Norris gets his program together, the company will be able to change quite a bit.

“First off, we will have a complete asset inventory in OT,” he said. “With that inventory, we will be able to immediately know if a threat applies to us or not and we will have the ability to track remediation of that threat on a real-time basis. The configuration will automatically be backed up and we will have a full audit trail so we will be able to see if something is happening that shouldn’t be happening. So, if something occurs to where we have to go back to configuration, we can do it quickly and we won’t have to reengineer.”

Overall, he said, this new system will lower vulnerabilities by quickly assessing threats.

Down the road, Norris feels automation will be a key driver for security where they could do something like patching via an automated approach.

The security progress LyondellBasell has made in the past nine years is huge and something any company can accomplish if they have the support from upper management and dedication and an open-minded approach from security professionals on the OT and IT side of the house.

“There have been some rocky roads, but we learned a lot,” Norris said. “Ultimately we are making progress, but the journey never ends, and it is a battle we will continue to fight.”

Pin It on Pinterest

Share This