Back to Top

Subscribe to INSIGHT

Expanding perspectives every month.

Subscribe

In order to reinforce the value of lessons learned (LL) and incentivize lessons learned sharing, NASA established criteria to identify and share lessons learned as agency-wide highlights. These criteria are applied by the NASA Lessons Learned Program Manager to evaluate submissions to the agency’s central lessons learned repository and determine items that should be shared and highlighted across the agency.   

  

Lessons Learned Lifecycle 

NASA identified four lessons learned lifecycle elements to provide clarity in understanding practices across the agency and help to identify areas where teams need greater support. Lessons may conceptually move across these elements in a non-linear fashion.   

 

Collect

In the collect phase, lessons learned are identified by individuals or teams. Lessons learned may be collected in a variety of ways, including pause and learn sessions, individual write-ups, or formal or informal team discussions.


Record

In the record phase, lessons are documented and captured. NASA’s principal mechanism for collecting and sharing lessons learned from agency programs and projects is an online database called the Lessons Learned Information System (LLIS). Depending on their nature and scope, the lessons may also be recorded in local repositories, reports and publications, case studies and/or via video capture and other means.


Disseminate

In the disseminate phase, lessons that have been documented are shared with others who can benefit from this knowledge. LLIS publication is one mode of dissemination. Others include courses and webinars, presentations, briefings and other knowledge sharing forums, the Spotlight on Lessons Learned article series, community of practice discussions, and general communications notices.


Apply

In the apply phase, lessons are integrated in NASA practice. This is a crucial step to ensuring that lessons are infused throughout agency activities. Lessons are applied through a variety of methods, including updates to processes, checklists, handbooks, and formal policy.

 

Agency-Wide Highlight Criteria

  1. Submitter shall concur with submission to the NEN/LLIS.
    Lessons submitted for agency highlights should be reviewed by submitters and their teams for dissemination to a wide audience. Note: lessons that are not approved for sharing with the public may be submitted to the NASA Engineering Network (NEN). These restricted lessons will not be eligible to be selected as agency highlights.
  2. Lesson shall be appropriate for a broad audience, and any limitations based on NASA policy and Federal laws and regulations must be clearly marked.
    Lessons should not contain management sensitive or competition sensitive information.  Although Controlled Unclassified Information (CUI) is permissible in NEN, it must be clearly marked, and lessons containing CUI require additional reviews before selection as agency highlights.
  3. Lesson elements shall have long-term validity and value to future work.
    Lessons should encourage the appropriate actions and decisions for the agency, its teams, and its partners under similar circumstances in the foreseeable future.
  4. Lessons shall focus on themes or elements with relevance to agency missions and/or agency operations with a direct impact on agency missions.
    Though generally technically-focused, content may incorporate any topics related to the agency’s critical knowledge. Therefore, administrative and operational lessons pertaining to activities and mission support functions in relation to their engagement with core mission activities also are encouraged.
  5. Lessons shall represent something new or a new perspective/refinement for previously documented lessons.
    New entries should not repeat previously documented lessons unless there is a change in understanding to the prior lesson.  Those lessons that offer actionable suggestions for addressing challenges in following existing procedures can be especially valuable.

 

Process for Lessons Learned Highlights

Using the lessons learned lifecycle elements, the following process is applied to identify and highlight lessons learned throughout NASA.  

1. Collect

  • Team identifies lesson of interest
  • Team drafts initial notes for sharing (may either submit directly or request assistance for editing based on local practices)

2. Record

  • Center, Program, or Mission team or LL steering committee reviews lesson
  • Team submits lesson to local or agency-level repository (LLIS)
  • Note: If not submitted to LLIS, highlight process stops here

3. Disseminate

  • LL Program Manager (LL PM) publishes lesson in NEN or public-facing LLIS based on publication standards
  • LL PM reviews lesson for agency highlight criteria
  • If lesson meets all agency highlight criteria, LL PM flags for APPEL Knowledge Services (APPEL KS)

4. Highlight

  • APPEL KS, NASA CKO community, and partners highlight lesson to appropriate audiences
  • APPEL KS incorporates lesson in training and webinars
  • Partner organizations and governance groups provide additional visibility to lesson as warranted

5. Apply

  • Centers, Mission Directorates, formal governance groups, and SME communities assess lessons for changes to policy, process, or other practice
  • Documentation and practices are updated as needed to integrate and infuse lessons learned

Lessons Learned Sharing Protocols

One advantage of NASA’s federated approach to knowledge management is that it supports lessons learned processes at different levels of the organization, allowing Center and Mission Directorate Chief Knowledge Officers to focus on capturing operational and technical lessons learned specific to local practitioners.

The chart below was developed by the CKO community in consultation with key stakeholders to describe the criteria used to determine which lessons are universally applicable and which are locally contingent or sensitive. Through these protocols, CKOs can maintain trust among their communities and support local and agency-wide processes for critical knowledge sharing.  

Lessons Learned Sharing Protocols Infographic. Three rectangular sections side by side. Left-most is “Immediate Team or Project”, middle is “Center or Mission Directorate,” and right-most is “NASA*” with an asterisk. There is a special note for this section, which is described later. These rectangular sections touch each other, and there is a small dotted line on the edges of the rectangles to show that individual items within the sections, which will be described, can be considered for broader distribution. Here are those individual items: under “Immediate Team or Project”, which is the left-most section, there are two boxes with headings Personnel Sensitive and Proprietary. Underneath is a description: “Lessons learned in this category are reviewed by immediate team. Individual items are rarely exchanged beyond involved parties.” Under middle section Center or Mission Directorate are two boxes: Center Competitive and Mission Specific. The description underneath is: “Lessons learned are reviewed by Center or Mission Directorate CKOs. Individual items may be exchanged among CKOs or groups.” Under third right-most section NASA are four boxes: Agency Wide Highlights, Lessons Learned Information System, Course Materials, and Historical Material. Underneath is a description: “Lessons learned in this category are reviewed and confirmed to meet basic standards from Agency Wide Highlights Process.” The note with the asterisk, which was mentioned earlier, is: “* With additional review, appropriate information from this category can also be shared with NASA partners and the public.”