[Knowledge Management Column]
[Edge] Home > Papers > Case study: Hunter Health intranet Contact | About | Search [Edge]
    
[Printed Version] [Document in PDF Form]
(542k PDF)
  
 
[Related Papers]
[Bullet]KM Column
[Bullet]Case Studies
[Bullet]Content Management
[Bullet]Intranets
  
 

[Upcoming Seminars]

  
 

[Find out when new papers are published.]

  
 

[Intranet Roadmap Wallchart]
Intranet Roadmap
Wallchart

  
  
Interested in syndicating our articles?
Find out more
  

NOVEMBER 2002
Case study: Re-focusing the Hunter Health intranet

by James Robertson
Published on 1 November 2002

Despite all the effort dedicated to the Hunter Health intranet, it was not being used, and no-one knew why.

With the initial start-up activities completed, the challenge was also to define the future direction of the intranet, and to ensure that it became better aligned with corporate strategy.

To this end, a brief but intense project was initiated to evaluate the current intranet and website. The goals: to deliver strategic and tactical recommendations on both sites.

By the end of the project, however, much more had been uncovered, including considerable insight into the corporate culture of the organisation, and the knowledge management requirements.

About Hunter Health

Hunter Health is the public health care provider in the Hunter region, North of Sydney. It has a staff of over 9,000 and manages sixteen hospitals and dozens of community health centres and other facilities.

Hunter Health has a strong reputation as an innovator of health care services and processes, and is often the pilot site for new systems and technologies.

The organisation is currently undergoing a sea-change in management, with the introduction of the 'balanced scorecard' approach. This is still in its early days of implementation and rollout, but is already having a major impact on strategic focus and direction.

'I found the intranet to be a wealth of information'
Staff person providing feedback on Hal

History of the intranet

The intranet (named 'Hal') had been in existence for just over a year, and was developed with the least resources we had ever encountered.

[The current Hunter Health intranet home page]
The current Hunter Health intranet home page (as of August 2002)

The intranet was initially created by a single person within Public Affairs, and there are now just two staff dedicated to managing the entire system. They have implemented a simple distributed approach, with each department or group using Dreamweaver to create and publish their pages.

Despite this very constrained approach, it was surprising how consistent and structured the intranet was - considerably better than much more expensive intranets we had seen.

What was notable was their recognition of the non-technical aspects of the intranet. This is a small selection of what they had implemented:

  • Generated interest in the intranet in a low-key way, through presentations and talks.

  • Trained users in how to use a web browser, and provided extensive phone support.

  • Trained authors in how to create pages.

  • Encouraged everyone to contact them directly if they had questions or problems.

  • Built a momentum, so that departments are now approaching the team asking to be added to the intranet.

  • Sent out a "what's new on the intranet" e-mail every two weeks.

  • Ensured that there were frequent references to the intranet in the various newsletters that are published.

  • Publicised the intranet via corporate letterheads, newsletters, e-mails and groups.

  • In short, marketed the intranet extensively.

  • Encouraged each department to conduct similar marketing efforts for their own subsites.

  • Developed a "contributor's kit" to help new departments get up to speed. This includes a corporate style guide, detailed instructions on how to use the authoring tools, and guidelines for good writing style.

  • Established a "web interest group" of all the various contributors and webmasters. This is a "community of practice", where they share best practice, obtain feedback on new designs, and learn techniques.

  • Developed a standard template, structure and appearance across the entire intranet. Enforced this, despite the decentralised manual authoring.

This is just a small selection of their intranet activities. Overall, the intranet team has done much to turn around a very change-resistant culture, and to develop a large and structured intranet.

The plan of attack

While these activities had done much to establish a strong foundation for the intranet, serious issues remained unresolved. Intranet usage was still low, and the future intranet strategy unclear.

In consultation with the intranet team, a number of activities were scheduled:

  • expert review
  • stakeholder interviews
  • usability testing
  • information architecture
  • Each of these is described in the following sections.

Expert review

This involved conducting an evaluation of the current corporate website and intranet against usability and accessibility guidelines.

The goal was to identify key problem areas and issues, and to get a sense of the information being presented.

[Page from the Learning & Development section]
Page from the Learning & Development section (as of August 2002)

Overall, the current intranet scored high marks. It was consistent, fairly well structured, and the majority of the content was well-written and to-the-point. There was a lot of good information on this intranet.

And yet, looking at the web usage statistics, it was clear that the intranet was not being used by most staff. The question was: why?

Unlike most intranets, it is not due to a lack of promotion or training. The intranet is run by the Public Affairs group, which has a strong grasp of the people and communication issues.

Instead, the following key site problems were identified:

  • The high-level structure of the intranet was counter-intuitive and difficult to use. Usage statistics showed that few users were progressing beyond the front page.

  • The search engine was custom-developed in-house, and was inadequate for an intranet of this size (6,000+ pages).

  • The homepage design was fragmentary and ineffective, and did not assist users to find key information or recent updates.

Overall, then, the issue was not the lack of information available on the intranet, but the difficulty in finding it. Thankfully this is a comparatively easy problem to solve.

By the end of the full day of expert reviews, a comprehensive list of design guidelines had been identified. These ended up in a separate document from the main recommendations, for the specific use of the intranet team and authors.

Stakeholder interviews

This was the core of the review process, and three full days were set aside for the stakeholder interviews.

The intranet team identified a list of participants, who were generally interviewed one-on-one. These were drawn from a very wide cross-section of the organisation, from Executive members and senior managers, through to clerical and clinical staff.

The aim was to be as representative as possible, within the limits of the time scale. In total, 14 stakeholder interviews were conducted.

A structured series of questions were developed before the sessions started, based on a knowledge focus, the experiences of the intranet team, and the results of the expert review.

These questions totally reversed the focus of previous surveys conducted at Hunter Health. Instead of looking at the intranet, they instead explored the job role, activities and information sources of each staff person. This led to questions such as:

  • What are the main activities that make up your job?

  • What information do you rely on during a normal working day?

  • Where do you obtain this information from?

  • If you have a question, where do you go to find an answer?

  • How do you find out about what's happening in Hunter Health?

  • What news stories are you most interested in?

Some of the clear results to come out of the stakeholder interviews included:

  • Everyone wanted to know what is generally happening within the organisation, such as building works, restructures, and the like.

  • No-one seems to want news about social events, preferring to rely on their own social networks.

  • Lack of time is a serious limiting factor, for all levels of staff.

  • Policies and procedures are a major issue across the organisation, and they warrant some serious attention on the intranet.

  • The corporate phone directory was needed by everyone, but was just not meeting that need.

  • Most information was being sourced from outside the organisation, which was surprising. A lot of resources are obtained from the Dept of Health site, and from other online resources. This suggested that most, perhaps all, staff need internet access to conduct their normal work.

It was pleasing, and very surprising, to see how open and honest staff were during these interviews. We were able to form a bond with most participants, and they went away satisfied that they had been given a chance to 'have their say'.

This generated a lot of 'buzz' in the corridors, and will undoubtedly help to reduce resistance to change when the project proceeds.

'If the information isn't correct, we come unstuck'
Switchboard staff outlining the problems when the phone directory is not correct.

Soundbites

A small innovation during the stakeholder interviews was to record notable quotes from the participants as 'soundbites'. These were then stripped of names, and used in the final report (they are also the source of the quotes that appear throughout this case study).

These proved to be tremendously effective and powerful, and served to underline the message delivered in the final report. By associating the issues directly back to individual staff concerns and comments, the soundbites made the report more concrete and tangible.

'Sharing experiences is important. Whether it is good
or bad, we want to know about it.'
Rural nursing staff, talking about the need to keep in touch with outcomes
across Hunter Health.

Usability testing

With the preliminary results obtained from the stakeholder interviews, a series of tasks were identified for the usability testing. Six major activities were identified for the hour-long usability tests, conducted with 10 different internal staff people.

Overall, the usability testing did not identify many substantially new issues or problems. It did, however, provide considerable supporting evidence for the results of the expert review and stakeholder interviews.

One lesson learnt was that in situations where the problems with the intranet are obvious and well-understood, the usability testing could be shortened, or delayed until later in the project.

We also found that the length of the usability tests varied greatly, from 20mins to the full hour, depending on the skill and experience of the participant. To cope with this, we developed a number of extra questions, to be used when testing advanced users.

If the session ran short, we also switched to running a stakeholder interview. This gained the maximum benefit out of the available time, particularly as the users were different from the earlier interview participants.

A range of interesting observations came out of the usability testing, including:

  • Few users understood the meaning of the 'text only' button, and none have used it.

  • While the more 'web literate' users understood the purpose of the 'site map' button, most users expected it to provide maps of the physical Hunter Health facilities. None of the participants have used this button.

  • Many users had overlooked the buttons at the top of the page, and had never used them.

  • Approximately half the participants solely used the search, while most of the remainder only browsed (using the sidebar menu).

  • All users extensively used the 'Back' button.

  • Only one participant used the browser 'find' command, to look for text within a page.

  • Most participants used the 'breadcrumbs', but only to link to the homepage. Very few users understood the hierarchy of pages in the breadcrumbs.

  • Many users navigated the site based entirely on past experience, and struggled when in unfamiliar areas.

It is interesting to generalise these results, and to compare them against commonly-followed standards. This highlights the value of practical usability testing.

We also took the opportunity to involve the intranet team in the testing, to give them enough experience to conduct further usability tests internally.

'It's an effective use of time. It saves me more than it costs me'
Staff person describing the value of e-mail.

Information architecture

The usability tests strongly confirmed that the high-level structure of the intranet was preventing users from finding information.

It was therefore decided to run a preliminary 'card sorting' session with local staff, to start to identify a better information architecture for the intranet.

This went well, and generated some good results. The main menu items the participants came up with were:

  • About us
  • Management systems
  • Projects & reports
  • News & events
  • Procedures, policies, guidelines & forms
  • Staff development and recognition
  • Units & services
  • Safety
  • Links

They also added two extra main menu items, to provide additional ways of finding information targeted at specific user groups:

  • Clinical
  • Admin

The session was a lot of fun as usual. Interestingly, the group was very egalitarian, with all participating equally. They walked away feeling pretty satisfied with themselves, and it was the talk of the corridors for the next few days.

Further card sorting sessions will be needed to encompass other primary user groups, such as clinical staff and admin. These will be run internally by the intranet team.

Like the usability tests, we involved the intranet team as part of the planned 'skills transfer' process.

(For more information on card sorting, see the article Information architecture using card sorting.)

'Sometimes it feels like you are re-inventing the wheel'
Allied health worker, discussing the difficulty of finding out what other
groups and states are doing.

Intranet goals

The evaluation project was extended by another day, to allow a new set of intranet goals to be brainstormed and refined.

After a collaborative effort in front of an electronic whiteboard with the intranet team, the following goals were identified:

Meet management needs

  • Support management processes, planning and decision making.
  • Support the implementation of the Balanced Scorecard.
  • Improve organisational efficiency.
  • Reduce business costs.

Improve communication and knowledge sharing

  • Support the sharing of knowledge and best practice.
  • Improve communication to, and between, staff.
  • Increase community involvement (both internally and externally).
  • Enhance partnerships with external organisations.
  • Facilitate and support learning.
  • Encourage research and innovation.
  • Facilitate and support teamwork.

Improve internal processes and practices

  • Improve timeliness, consistency and quality of information and processes.
  • Provide easier and more efficient work practices.
  • Provide a common platform for internal systems.
  • Improve the transparency of decision making.
  • Improve quality and consistency of staff orientation information.
  • Improve patient care, outcomes and safety.
  • Improve staff safety.

Support cultural change

  • Improve staff morale.

These are ambitious goals, and not all will be met in the short-term. They do serve, however, to define a 'road map' for future intranet development.

The goals will be backed up with a number of measures ('metrics') to assess whether they have been met, and to track how they change with time. These will be defined in a future activity.

'For first time users of Hal, some things are a bit
too far down, and are hidden'
Staff person describing their observations of novice intranet users.

SIDENOTE
Frustration not an issue

One of the key questions used in the stakeholder interviews for the Area Health Service was: "What is the most frustrating administrative task that you have to do?". It was expected this would identify a raft of administrative and organisational hassles that could be addressed by the intranet.

Instead, these are the soundbites collected relating to this issue:

  • 'I just do': staff person indicating that they don't get frustrated by administrative tasks, they simply manage day by day.

  • 'There's no one big bugbear, I guess': response when asked about frustrating administrative tasks.

  • 'I just get on and do it': staff person talking about the administrative tasks they have to do.

  • 'Things that have to get done, part of the job': manager talking about the time spent dealing with administrative tasks.

In short, being part of the public service, staff simply took for granted that administrative tasks are difficult and inefficient. In fact, the word "frustration" did not, in general, generate any immediate recognition or associations.

This was a big surprise, as it is typically taken for granted that the intranet should be used to automate common administrative tasks, as one of the first steps. Instead, the following recommendation will come out of this review:

  • There is little short-term value in focusing on using the intranet to streamline organisational or administrative activities.
    


    

Strategic recommendations

A large number of strategic recommendations were identified as a result of the evaluation. These have been briefly summarised below:

Integrate the intranet into daily work practices

If the intranet is to be truly successful, it must be used by staff on a daily basis, as their primary source of news, information, tools, and other resources.

Improve intranet resourcing

Further funds must be provided to the intranet if it is to become a strategic asset for the organisation.

Develop a staff directory

In place of the current systems, a full staff directory must be developed, as this underpins many of the strategic goals of both the intranet and the Balanced Scorecard.

Develop a knowledge-sharing culture

A project should be established to explore how a knowledge sharing culture can be developed within Hunter Health.

Broaden the reach of e-mail

E-mail is now used as the primary form of communication within Hunter Health, across all job roles and levels. This has generated considerable benefits, and access to e-mail should be broadened to encompass the greatest number of staff possible.

Improve the management of e-mail

While e-mail has proven to be a valuable tool within the organisation, many users are now overwhelmed by the volume of e-mails that they receive. Most frustrating are the irrelevant or 'junk' e-mails.

Provide universal web access

The review process has identified that most staff rely on internet access to conduct their key daily activities. Internet (web) access should be provided, by default, to all management, clinical and admin staff.

Align with the Balanced Scorecard

The role of the intranet should be formally recognised within the Balanced Scorecard, and managed in a coordinated way with other strategic initiatives. This ensures the greatest business benefits will be obtained.

Use storytelling to support organisational change

Storytelling is a powerful method that conveys considerable information and context, throughout the use of narrative. By using storytelling, messages can be delivered in a much more effective way than guidelines or policies.

Use the intranet to support geographically isolated staff

There are many staff with limited access to centralised Hunter Health resources, and even fewer mechanisms for communicating with other staff. This includes both rural staff, and those involved in community and allied health services.

'I like people being congratulated'
Staff person indicating that they like to read about 'good news' stories.

Formalise the role of authors

Staff must be provided with sufficient time to produce high quality intranet content. This has a major impact upon the overall usability of the site, and the business benefits that it delivers.

Improve transparency of decision making

All staff identified that they were interested in hearing news about corporate directions, restructures, new building works, and other high-level organisational issues.

SIDENOTE
No demand for social news

  • 'I don't have time to get involved in the social issues at the area level': staff person indicating they don't read the social news, except in their local newsletter.

  • 'To me, they are just another thing I don't want to know about': rural staff discussing the large volume of social e-mails they receive.

As part of the stakeholder interviews, staff were queried about the type of news they value. Not a single participant expressed any interest in receiving 'social' news via the various newsletters, even when specifically asked about it.

Instead, staff relied on their local social networks to hear about activities that are of interest to them. These could be conveyed via a local newsletter, face-to-face gossip, or e-mails.

As such, the area-wide newsletters should not be used to disseminate social and community news. Instead, they should focus on conveying details on broad initiatives, projects and building works.

    



    
Enhance the dissemination of news

There are considerable challenges in communicating news to staff in a large, diverse and geographically dispersed organisation such as Hunter Health.

Develop an integrated intranet platform

One of the primary advantages of the intranet is that it provides a common (web) interface across all information sources. In this way, a number of different systems can be used to publish content, with the user seeing only a single, seamless, intranet.

Develop targeted sub-sites

The current 'Doctor.Net' (and upcoming 'Nurse.Net') sub-sites on the intranet are an ideal example of the targeted information delivery approach that meets staff needs.

Enhance policy information

The Hunter Health policies and procedures are an important resource which underpin the daily activities of the health service.

Improve staff orientation

The orientation materials must be rewritten to incorporate a standard module on Hunter Health systems and process ('how we do things'), including use of the intranet.

Improve intranet skills of staff

Many staff, particularly those in the areas of nursing, allied health, and rural services have not used the intranet. Yet, these are the very users who would benefit most from this information, as they do not have access to alternative informal networks.

'It's a big organisation, and the little small person down there needs to be tapped into so much'
Staff person talking about the desire to know what is happening.

Tactical recommendations

In addition to the longer-term strategic issues, a number of short-term tactical recommendations were made. These are summarised below.

Beyond these recommendations, a range of small site-specific guidelines were identified. These were documented separately, and provided for the use of the intranet team and authors.

Replace the search engine

The lack of an effective search engine is one of the major barriers to the success of the intranet.There are a number of excellent free search engines that would be suitable for use on the Hunter Health intranet.

Improve site structure

There is much useful information on the intranet. If this is to be of value to users, the site needs to be restructured so they can easily and efficiently find required details.

Maximise the value of the homepage

The homepage is the most valuable 'real-estate' on the intranet, and users are presented with it when they first open their browser. The homepage should be redesigned in conjunction with the site restructure.

Restructure key sections

Key sections must be restructured to ensure they are easy and efficient to use. They can then become 'gold standard' examples that other sections of the intranet can model themselves on.

Define measures for the intranet

Key performance measures ('metrics') should be identified for the intranet goals.

Implement a content management system

The current processes for creating and maintaining intranet content are labour-intensive and cumbersome. To improve the manageability of the intranet, a content management system (CMS) should be selected and installed.

Schedule regular usability testing

Small-scale usability should be conducted every six months, to identify new problems with the ever-changing intranet. These would be conducted internally by the intranet team.

Enhance feedback mechanisms

The use of feedback is vital to building a healthy intranet. It 'closes the loop' with staff, by providing them a single robust mechanism for communicating issues and needs to the managers of the intranet.

'Clearer reference material should help our staff
to reduce mistakes'
Unit manager, talking about the benefits of a current project
to improve their documentation.

Moving forward

The mix of short-term tactical recommendations, and long-term strategic goals provides Hunter Health with both an immediate 'action list' and a future direction.

Already, the authors have shown enthusiasm for the revised design guidelines, and have started updating their sub- sites to match.

In recognition of the limited budget available, most of the recommendations do not require much beyond the effort of the intranet team, and only a few involve IT purchasing costs.

The intranet team has started scheduling the tactical activities, and will work through them in sequence.

Once the short-term fixes have been implemented, the plan is to purchase a full content management system (CMS). This will have a major impact on the manageability of the intranet, and will support many of the strategic goals.

Conclusion

Considerable forethought and effort had gone into the development of the intranet. In only a year, a substantial and generally consistent resource had been created for the benefit of all staff.

With these initial efforts gaining a momentum of their own, it was an appropriate time to step back and assess the strategy for the next phase of growth.

By conducting a brief, but intense, evaluation project, considerable information has been gained about the issues with the current site, and future directions.

In total, the project took a little over 15 full-time days on site. Within this tight constraint, it was still possible to identify important cultural issues, and to re-invigorate the intranet project as a whole.

Hunter Health is now in a strong position to take the intranet forward as a strategic asset that benefits both staff and management.

Facts and figures

Facilities

  • 16 hospitals
  • several dozen health centres
  • supporting units

Figures

  • Total staff: 9,000
  • Number of networked PCs: 2,800
  • Number of intranet pages: 6,000+
  • Average visits per day: 500
  • Age of intranet: 1 year

Technology

  • Authoring tool: Dreamweaver
  • Content management system: none
  • Intranet server: Microsoft IIS

Methodology

Based on the success of this short project, we generalised this approach into a methodology that could be applied to any intranet.

This forms the basis of the previous KM Column article Sixteen steps to a renewed corporate intranet.

About the author

James Robertson is the managing director of Step Two Designs, a knowledge management consultancy based in Sydney, Australia. James specialises in establishing knowledge management systems, information design, usability and XML development.

If you have any comments on this article, please send them to:
jamesr@steptwo.com.au

Printed version of this article (PDF)

For questions or comments please contact the Webmaster. Last updated 10 March 2005. © Copyright 2005, Step Two Designs Pty Ltd, ABN 99 081 019 623. All rights reserved.
Intranet Peers and Intranet Roadmap are trademarks of Step Two Designs.