“Profound” is how Captain Richard Champion de Crespigny described the significance of A380 VH-OQA Nancy-Bird Walton’s return to the Qantas fleet.
Qantas’s first Airbus A380 and hence the symbolic flagship of the airline’s fleet, VH-OQA returned safely to Singapore under Captain de Crespigny’s command after an uncontained explosive failure of its number two Rolls-Royce Trent 900 engine soon after takeoff when bound for Sydney on November 4 2010, operating flight QF32.
“The aircraft was challenged in an incident that is not part of the certification requirement. It was extensively damaged, we were operating outside the protected environment provided by certification standards, and we were on our own,” Captain de Crespigny recounted to Australian Aviation in April 2012 (for this feature article which was originally published in the June 2012 issue of Australian Aviation – Ed).
“Once you understand the severity of the incident, you can only come out with the greatest pride for the A380. It was over-engineered like the Sydney Harbour Bridge. The 380 has been over-engineered beyond the certification requirements, and that’s why when we got challenged with a ‘black swan event’, it didn’t just survive, it flew beautifully and 469 souls returned safely home.”
At about 9.20am on Sunday, April 24 2012, Nancy-Bird finally came home, touching down in Sydney and symbolically completing her QF32 flight from Singapore – an exclamation mark on the most significant air safety event and the culmination of the most extensive and expensive aircraft repair in Qantas’s modern history.
“The QF32 was one of the biggest events of its kind that Qantas has gone through. It was significant for the damage done to the aircraft and I think for how the whole organisation handled it,” Qantas CEO Alan Joyce says.
“And what I was very proud of was when you have an event like that and you talk about safety being your number one priority … you can see it coming through to reality.”
Even before Captain de Crespigny, his crew and passengers had landed safely back in Singapore, Mr Joyce and the Qantas executive team had taken the momentous decision to ground the airline’s A380 fleet, a decision unprecedented in Qantas history.
“Grounding the aircraft showed we were never going to put commercial concerns ahead of safety. It was absolutely the right call, looking back in hindsight, and it was made extremely fast on the day,” he tells Australian Aviation.
“How the pilots handled an unbelievable situation shows the level of training that we invest in our pilots – which I believe is two to three times more than most airlines do – really paid off in terms of the abilities and capabilities in handling it.”
He then highlights “the calm way the cabin crew, headed by the CSM Michael von Reth, handled the situation and kept the cabin calm and in control. With an engine that couldn’t be shut down, the whole disembarkation of the passengers safely, managing that was superbly handled.”
That successful landing and disembarkation brought the QF32 incident to a happy ending, and meant the process of assessing, repairing and returning to service Nancy-Bird could begin.
“Repairing this aircraft was probably the biggest repair job in aviation history,” says Mr Joyce.
DAMAGE ASSESSMENT
For the crew of QF32 the true magnitude of the damage endured became apparent once they were able to inspect the aircraft after the passengers had been deplaned and number one engine was finally shut down.
But for then head of Qantas’s Maintenance Operations Centre Alan Milne and now chief of its Integrated Operations Centre, who would oversee the aircraft’s subsequent repairs, the real moment was when Qantas maintenance manager Tim Gent arrived in Singapore very soon after the event.
“He rang me from the aeroplane, he’s walking around on the phone to me describing the aircraft to me … and when I heard him describing it – I’d seen the photos, I’d known what had gone on – but to hear him physically describing it, I went: ‘oh shit, this is pretty big’.”
The damage he saw is starkly described by the ATSB interim report into the incident: “The failure of the number two engine ejected a number of engine components that struck the aircraft or were liberated overboard.
“Sections of the intermediate pressure (IP) turbine disc penetrated the leading edge of the left wing inboard of the number two engine, resulting in damage to the leading edge structure, the front wing spar and the upper surface of the wing.
“A small section of liberated turbine disc penetrated the left wing-to-fuselage fairing, resulting in damage to numerous system components, the fuselage structure and elements of the aircraft’s electrical wiring. Released debris also impacted the left wing’s lower surface, resulting in a fuel leak from the number two engine fuel feed tank and left wing inner fuel tank.
“Other impact damage was observed to the number two engine support pylon, the number one engine, the left fuselage keel beam support splice and the left wing false spar. A small impact region was also observed on the left side of the aircraft’s fuselage.
“Impact damage from the liberated engine debris affected a number of aircraft systems. Damage was observed to elements of the aircraft’s electrical wiring that affected the operation of the hydraulic system, landing gear and flight controls, a number of fuel system components and the leading edge slat system.”
The result was the most extensive and expensive repair in Qantas history, bigger than the repairs to 747-400 VH-OJH which as QF1 overran a wet runway at Bangkok in 1999.
Mr Milne explains: “This was the first major wing damage event. Previously [QF1] was fuselage damage, which while complex and involved is not the main load-carrying structure of the aeroplane. So the major damage to the wing section itself, including the forward spar, the upper and lower wing skins – that’s what made this complex and big.”
Planning for Nancy-Bird’s repairs began almost immediately she was back on the ground.
Airbus executive vice president customer services Didier Lux emphasises that an aircraft repair of this magnitude is not something left to chance: “It is a really functional approach done [in partnership] with the expertise of Qantas. The result is this aircraft, I would say, is as good as a new one.
“The first thing was to work with Qantas on the assessment of the damage. When the decision is taken to repair the aircraft, each [area of] damage is analysed by experts in the different engineering areas of Airbus, whether it is the fuselage, wings, systems, they work to propose a repair. All that is managed through the project management [process].”
The next step is production of the parts. As soon as the repair is defined, parts are ordered and made and job cards are prepared for the repair team in Singapore.
“Then we move to the preparation on site, having the job cards, the drawings, the parts, the tools. It was very important to have the tools because the aircraft was jacked to have zero stress. Then during the repair you have full engineering support [available] because each time it is not as expected, there could be some changes, available in real time connected with the team here to react in case we find things that weren’t as expected.”
While Airbus was responsible for the design and implementation of the repair work, the aircraft remained in Qantas ownership throughout the process and as such oversight was governed by CASA requirements and the Qantas AOC.
As such, Qantas’s maintenance controller, who under the terms of the AOC is the one person accountable for all the maintenance on the Qantas fleet, ultimately is responsible for any issues with and oversight of the repair. Consequently, the maintenance controller appointed Qantas engineering personnel to work with Airbus on the design and implementation of the repair.
“It was a collaborative effort. It was not Airbus saying ‘this is what we are going to do, see you later’. They were sitting down together, they were discussing it, saying ‘maybe that is the best option here’. They were deeply embedded in the whole process,” Mr Milne says.
CASA also sent inspectors to Singapore on a number of occasions to inspect the repair work as part of its oversight role as regulator.
“Singapore Airlines and Airbus were all approved to do the work,” Mr Milne notes. “But ultimately before the first assessment flight and before the flight back to Sydney, it was a Qantas engineer who signed the logbook.”
DOWN TO WORK
Tim Gent was Qantas’s project lead for the repair, working out of Sydney and regularly visiting Singapore: “The collaboration that I’ve witnessed between Qantas and Airbus is like something I’ve never seen,” he says. “It absolutely had to be. We couldn’t have done this without the support of Airbus and many other providers such as Singapore Airlines Engineering and some of our vendors.”
The repair process began with assessment of the damage and repairs needed and, with Qantas, determining the repair methodology to be used. The assessment process ran for six weeks over Christmas-New Year 2010-11, once regulatory and investigatory authorities such as the ATSB had released the aircraft.
The result was that the aircraft was deemed to be economically repairable but that temporary repairs were not viable and it would have to repaired in situ in Singapore. Thankfully, Singapore’s Changi Airport is home base for Singapore Airlines’ A380 fleet, and SIA Engineering made available its own A380-capable hangar for the repair work.
“The facilities available to us were remarkable,” Mr Gent notes.
Airbus proposed its repair plan for Nancy-Bird in February 2011 and by April agreement had been reached with Qantas on how to proceed.
Airbus director of customer support and services Derek Blackham explains: “Our focus in this case was to repair with new parts as much as possible and to have the aircraft ‘as-new’ when finished.”
One of the key challenges was the need to jack up the aircraft on jigs to bring it a zero g state, as it was in the Airbus factory during production, so there would be no undue stress on the wing during the repair.
“It was clear we needed to get the aircraft back to an almost factory condition to enable the scope of repairs,” Mr Blackham says. That meant the first jigging of an A380 outside of the factory, which put in train a major logistical effort to ship jigs from Europe, including some tooling that had to be specially made for the repair.
Over 40 tonnes of tooling and jacks were shipped via two sea freight shipments supplemented by over 1,000 airfreight deliveries of replacement spare parts. In all, Nancy-Bird spent 116 days on jigs in SIA Engineering’s A380 hangar between July 6 and October 22 2011.
During that time the damaged area of the top wing was replaced by a custom-designed patch, while a new lower wing skin panel and replacement section of the forward spar – this is built in sections so the damaged section was simply replaced with a new-build spar section – and a new number two engine pylon were fitted.
“The replacement upper panel patch featured integral reinforcement, which was critical to maintaining the A380’s aerodynamic performance. To accommodate the panel’s reinforcement modified wing stringers also had to be fitted.”
Indeed, Mr Blackham remarks that the repair patch panel was a “phenomenal” piece of engineering on the back of a “huge” effort by around 40 Airbus engineers in the UK, where the A380’s wing was designed and is built.
A dedicated three-dimensional laser scanning tool used for a repair for the first time, allowed detailed measurement of the wing’s profile to ensure the patch exactly fitted the profile of the wing as originally delivered.
“And it did fit perfectly.”
Interestingly, one of the repair’s contingencies was building repair components, including the upper wing patch, in duplicate, in case of error or something happened during the rebuild.
While the upper wing patch was the most technically difficult element of the repair, seeing the forward wing spar section removed was perhaps the most arresting aspect of the work.
“Fortunately the front spar is built in sections, so we could de-bolt existing wing joints, take out the old front spar section and replace it with a completely new part, which had to be specifically machined to accommodate the top wing skin,” Mr Blackham says.
“Seeing an A380 with the forward spar removed is just unbelievable,” Mr Gent remarks.
Damaged systems and wiring were also replaced – including 5km of new wiring harnesses – while all four engines were replaced with new ones.
Once the A380 was rolled out of the hangar to allow Singapore Airlines to conduct its own routine A380 maintenance, work continued initially in the open or in another Singapore Airlines hangar. This included fitting new flaps and fairings, then systems checks, taxi tests and ultimately, flight tests.
“The testing has been outstanding. All systems came back to life as expected. We preserved the aircraft very well from the event,” Mr Gent says.
“The aircraft is now back as good as new. That’s the way we planned it,” adds Mr Blackham.
In all, the repair involved over 70,000 production and 50,000 design hours. Further, the repairs added less than 100kg in extra weight to the aircraft, a tiny amount compared to the A380’s 560 tonne maximum takeoff weight.
With the repair work completed, taxi and flight testing followed, with acceptance testing following procedures designed for new build aircraft.
“The difference was the extent of the repair and the length of immobilisation and storage over a long period [compared with other acceptance flights of aircraft coming out of maintenance and repair work],” Airbus flight test engineer Andrew Daws explains. “In that context what we do is adapt the test schedule content to check out the aeroplane as if it were new.”
That “shakedown process” took place over two weeks in April and even though system testing takes place as part of the final repair process, “we come in from zero, with an objective that checking that all the systems come up, that they work correctly and you can immediately transition to the operational handling of the aeroplane without any failures”.
This means testing electrical modes, the ventilation system in the avionics bay, the air conditioning system and APU runs.
As Nancy-Bird’s APU had been removed during the repair process, as well as all four engines, “we were interested in seeing how the system would run off the APU”, Mr Daws says.
“Running off APU for eight hours a day [in Singapore’s heat and humidity] is potentially a challenge if the aeroplane is not ready for it. But in this case things went very well.”
One important test was a ground cabin pressurisation test: “What we are looking for, we know there have been some repairs to the fuselage, there have also been harnesses that have been removed through bulkhead pressure seals on the aeroplane, so we want to make sure those things are going to be ‘tight’ and correctly reinstalled so that we don’t have any surprises when we fly.”
The static test phase saw 120 test points checked off before engine runs began. In all, ground testing took place over eight days, three days of which the aircraft was unavailable for testing while its repaired areas were repainted.
By April 14 it was ready for taxi tests around Changi Airport, during which steering and braking were tested in normal and backup modes, and culminating in a rejected takeoff test.
Given carbon brakes can be affected by moisture ingress, one of the technical concerns was being sure the brakes worked as required, so repeated brake applications ensured the brake packs heated up to dry them before the aircraft lined up on the runway for the rejected takeoff.
Mr Daws says: “We accelerate down the runway and we stop, so we are looking at the brake system operation, the health of the brakes themselves – and it is the last chance to effectively check the air data systems that feed into the flight control computers.”
The way was now clear for the first technical flight on April 15.
AIRBORNE AGAIN
As the aircraft is owned by Qantas, pilot in command for the test flight (as well as the taxi and rejected takeoff tests) was Qantas A380 technical pilot First Officer Ben Holland, with an Airbus flight test pilot beside him and two engineers onboard.
“We departed about 7am with four crew onboard,” he said. “It was really nice, we taxied down past where the guys had been working for the last three months. They were all lined up on the taxiway to give us a wave goodbye.”
Early signs were promising: “It was a full thrust takeoff, and right from the start when the aircraft got into the air it performed superbly.”
The extensive four-hour flight testing was largely done in a block of airspace 60nm east of Singapore, where the A380’s operational envelope could be validated. Checks included flying at up to 70 degrees angle of bank to check bank angle protection, pitching up and down to create bending moments in the wing and flying to the aircraft’s 43,000ft certified maximum operating altitude, high-speed cruise, an overspeed on descent to test emergency activation systems, a series of engine shutdowns and restarts, both using APU assistance or only the natural airflow to restart the engines, checking for sufficient fuel flows when the fuel pumps are switched off, hand-flying the aircraft and hand-controlling the thrust to check the aircraft’s low-speed handling when flight envelope protection systems are deactivated, flap overspeed warnings are checked, alternate gear extensions performed and an emergency electrical generator test.
On return to Singapore a low-level go-around was performed to check the triggering of flight envelope protection systems.
“We completed that and came back and after four hours and 20 minutes did an automated landing. And throughout it all the aircraft performed superbly,” First Officer Holland recalls.
“So at the completion of the flight, the aircraft has been put through sequences and checks that are the equivalent of what we put it through when we are accepting delivery of a new aircraft up in Toulouse.”
A subsequent, briefer validation flight evaluated the aircraft cabin systems such as galley and IFE operation before Nancy-Bird was able to depart for Sydney late in the evening of April 21.
A COSTLY REPAIR
Extensive repairs are expensive. The direct, $139 million cost of the repairs covered by Qantas’s insurers, was significantly below the insured write-off value of the aircraft. But there were other costs to Qantas due to the subsequent grounding of its A380 fleet and the brand damage that comes from a major air safety incident.
In the end, Rolls-Royce reached a financial settlement with Qantas of $95 million to cover those costs and disruptions.
Mr Joyce says: “Grounding the fleet for 20-odd days, not flying it to LA until January two months later and then the ongoing maintenance requirements of swapping 17 engines, and then this aircraft being out of service 18 months – we estimated at the time that was $80 million, and [from the $95 million] there was a contribution towards the brand damage and the recovery of the brand.
“And the brand fully recovered because with the subsequent reports it was very clear that this was not a Qantas problem, it was a problem with the manufacturing of the engines. We’re comfortable that Qantas was not financially out [of pocket] at all with the whole incident.”
AN EMOTIONAL RETURN
But clearly the return of Nancy-Bird is not just about dollars and cents.
“You had aircraft engineers, grown men, crying when they saw this aircraft take off for the first time,” Mr Joyce says. “For everybody onboard this aircraft when it took off [for its return to Sydney] it was very emotional.”
“I don’t know in any other business environment where you would have a passionate link to a brand like this. I think it’s phenomenal.”
For his part, Captain de Crespigny says he followed the progress of the repairs to VH-OQA intimately, and that “you can’t help not” have an emotional attachment to the aircraft.
“Because the passengers came out of the terminal so happy and the aircraft survived so well, no-one immediately appreciated the scale of the damage. Indeed, many pilots later told me ‘what’s the big deal – it’s just another engine failure’. But the closer you got, the more you became awestruck about the level of damage. Every person who became involved with the repair, when they first get close enough, stopped, went silent then just said ‘Wow’. They understand how well the aircraft performed, how well all the teams performed, and they were proud and privileged to be part of the teams that brought Nancy-Bird back to full health.
“I put the probability of this event happening again as one in ten to the power of fifteen, that’s a million times less probable than the most stringent certification protection. It’s a credit to everyone at Airbus that Nancy took such a beating and unbelievable damage and 469 survived. It’s fantastic!”
Says the Qantas CEO: “This aircraft survived something it wasn’t meant to survive, and I think that’s great to know, that we have this solid flagship within the fleet.”
This feature article originally appeared in the June 2012 issue of Australian Aviation
