Application of Statistical and Other Quantitative Techniques in Software

Application of Statistical and Other Quantitative Techniques in Software

The February 2023 tech talk was presented by Stephen Shook

Abstract

The CMMI has long emphasized use of “statistical and other quantitative techniques” as a best practice for software work. Many organizations struggle with how to apply those techniques. (The ISHPI AIS Division did, too.) What techniques should we use? What business problems will these help us to solve? And, most importantly, what really adds value? This presentation provides a survey of the techniques that we use, and how we use them. Examples include linear regression, prediction intervals, control charts, histograms, and tests for statistical significance. ISHPI will discuss how they apply “quantitative and statistical techniques” in their software work, along with the underlying data and examples from individuals, project teams, and the overall organization.

About the Presenter 

Stephen Shook, ISHPI’s Vice President of Software Engineering and Quality, brings more than 25 years of experience in senior management, business development, development management, project management, software engineering, and implementation of Capability Maturity Model® Integration (CMMI®). He is one of the principal architects of ISHPI’s award-winning Agile High Velocity Development℠ software development methodology, which is appraised at CMMI Development Maturity Level 5. As an experienced instructor, coach, consultant, and subject matter expert, he leads and mentors software teams to achieve exceptional cost, schedule, and quality performance in order to achieve customer business goals. Stephen has a Bachelor of Science in Computer Science and Mathematics from the University of Illinois.

Implementing a Strategy for Excellence

Implementing a Strategy for Excellence

The January 2023 tech talk was presented by Seemin Suleri

Abstract

In our pursuit of excellence, we built a strategy that matched the ambition of a competitive e-commerce business. The problem was, where do we start the work: A struggling software department with high attrition and low engagement, a software system that was falling apart, a monolith that was hard to break away from. This talk covers how the real work was done on the ground to achieve great results. It also gives practical advice on where to find tools that enable you to measure the effectiveness of the strategy. For anyone who is tasked with bringing a vision to reality, this talk is packed with ideas that generated high performance, high engagement, and better quality products 40 times faster.

About the Presenter 

Seemin Suleri

Seemin is an agent for change in a competitive digital world. Specializing in building and leading high-performance self-organizing teams, she has enabled businesses to transform their cultural and technological landscape. She has a real passion for Agile and continuous improvement. Currently working as Head of Engineering for 288 Group Ltd, she is leading the company’s systems transformation effort to meet the demands of the ever-evolving and competitive market.

She is a mum of two energetic preschoolers, and is passionate about flexibility and inclusion in teams to allow people from all backgrounds to succeed. She has led a number of initiatives to increase the representation of women in software, and is always interested in the human element in organizational success. She is an enthusiastic individual with a background in both software engineering and project management, coupled with the ability to operate within an array of engineering disciplines to unblock flow and get the job done.

NAVAIR Process Dashboard Introduction Workshop

NAVAIR Process Dashboard Introduction Workshop

Abstract:

NAVAIR has hundreds of engineers/professionals using Team Software Process (TSP) or Team Integration Process (TPI) methodologies to plan and track their projects. NAVAIR teams following TSP/TPI use the Process Dashboard tool to implement the methodologies. This workshop is given by the Performance Resource Team (PRT) to introduce individuals to the Process Dashboard tool and to give them ‘hands-on’ experience in various features of the tool. Downloads are provided to allow workshop participants to exercise the features first-hand. Here are the topics covered in this workshop:

  • Process Dashboard Fundamentals: The objective of this topic is to understand how to use the primary features of the Process Dashboard tool when working on a TPI project. These features include:
    • Selecting the active task
    • Logging time
    • Logging mistakes
    • Completing a task
    • Logging actual sizes
    • Tracking your progress against your plan
  • Personal Projects: The objective of this topic is to demonstrate Process Dashboard changes to support the creation of personal projects (a.k.a. ‘Armies of One’)
  • Work Breakdown Structure (WBS) Editor Fundamentals: The objective of this topic is to demonstrate how to use the primary features of the Process Dashboard’s WBS Editor to generate a project plan. WBS Editor features discussed include:
    • Relative sizing of work using Proxy Estimation Tables
    • Task generation using workflows
    • Load-leveling individual plans using Team Time Balancing Panel
  • Using PROBE with Process Dashboard: The objective of this topic is to provide an introduction to the Proxy-Based Estimating (PROBE) process, and to illustrate its use within the Process Dashboard.

About the Presenter 

Brad Hodgins is a computer scientist and has been supporting Naval Air Systems Command (NAVAIR) for 36 years. He has over 20 years’ experience developing simulation and avionics software. He has spent the last 16 years as a project planning and tracking coach and instructor for the Performance Resource Team (PRT), actively coaching project teams in the development of high-quality products for on-time, on-budget delivery to the fleet.

Brad has expertise and a national reputation in process improvement. During his time with the PRT, Brad gave over two dozen presentations at symposiums and conferences, and authored/co-authored half a dozen published articles and papers, all sharing the great things NAVAIR has been doing. Brad was given a Navy patent in 2008 for the Learning Applying Mastering Perfecting (LAMP) model for team process implementation evaluation and improvement. He was awarded the Michelson Laboratory Award in 2010, and he became a NAVAIR Associate Fellow in 2013. Brad earned a Doctorate in Computer Science from Colorado Technical University in 2015. He retired from government service in 2019, but continues to support NAVAIR as an employee of Saalex Solutions Inc.

Brad is a Taurus and likes surfing (just kidding about the surfing).

Accelerating Innovation by Transforming into a Digital Engineering Approach

Accelerating Innovation by Transforming into a Digital Engineering Approach

The November 2022 tech talk was presented by Jeff Schwalb and Will Walker

Abstract

In the past, the Department of Defense has primarily used a document-based approach for all cradle-to-grave systems development. This approach to systems engineering produces tons of artifacts (especially if shared on paper) in the form of a disjointed set of text documents, spreadsheets, diagrams, and presentations that may or may not be configuration managed in a further disjoint set of repositories. Even worse, the artifacts themselves become disjoint, unreliable, and expensive to maintain!

As the systems we design now and into the future gain complexity, the rework necessary when a change occurs will becomes more and more expensive, as engineers need to modify many documents to keep them up to date. Even worse, it becomes more confusing to know which of these document sets has the most up-to-date information. 

Digital engineering provides a method to use tagging and active interdependencies between design models to enable changes to be made in one location that will propagate throughout all other relevant design models. This means that all interconnected models will contain the most up-to-date data at any given moment in time. 

There are advantages and complexities to converting to digital engineering, which will be covered in the presentation.  Digital engineering and Model Based Systems Engineering (MBSE) implementation steps will be outlined, and the future goal of the transformation will be relayed.

About the Presenters

Jeff Schwalb is a computer scientist and has been supporting Naval Air Systems Command (NAVAIR) since 1984. He has over 20 years of experience developing and acquiring real-time embedded software systems for avionics, weapons, and range instrumentation systems. He also began collaborating with the Software Engineering Institute (SEI), learning and applying CMM key practices, becoming a certified Personal Software Process℠ (PSP℠) instructor and then a certified Team Software Process℠ (TSP℠) coach. Over the last 25 years, he has taught and consulted with hundreds of scientists and engineers in various forms of personal engineering processes and has coached dozens of projects in the launch and operations of team project planning and tracking.

In 2017, Jeff connected with the SEI on the establishment of the organization we know today as the Software Excellence Alliance (SEA). Today, Jeff continues to work within the SEA to identify and establish pragmatic, value-added solutions to problems currently affecting the software community. He is currently serving as a member of the SEA Executive Team and as a supporting member of SEA working groups in areas such as Membership, Agile Community Networking, and Knowledge Transfer.

Will Walker is currently a Principal Systems Engineer at Raytheon Intelligence and Space (RI&S) who consults with many RI&S programs to help them implement a digital transformation strategy. At Raytheon, he also teaches classes including an “MBSE Bootcamp” class to Raytheon employees all over the globe. These classes focus on a mixture of architectural design principles, Cameo/MagicDraw software buttonology, SysML/UML language details, and Digital Engineering (DE) principles and objectives.

Will has worked on space, Air Force, Army, and Navy programs during his career on both the government side (NAVSEA) and the contractor side (Raytheon and L3Harris). He has worked on underwater unmanned vehicles, underwater mine warfare systems, drone boats, unmanned aerial vehicles, medium range missiles, radar, and other satellite subsystems. He has his undergraduate degree in mechanical engineering and graduate degree in systems engineering. Will enjoys both teaching and consulting for DE and MBSE, and is excited to see how the digital transformation continues for years to come. 

Will happily lives in Dallas TX with his wife and their dog. He goes kiteboarding in his free time and enjoys cooking something new.

Why Can’t Johnny Program Securely?

Why Can’t Johnny Program Securely?

The October 2022 tech talk was presented by Robert Seacord

Abstract

Secure coding (unsurprisingly) is hard. Our educational systems have failed to properly prepare students, and our assessments have overestimated their abilities. Analysis and testing is useful but inadequate. This presentation will discuss the gap in qualified secure coders and what we can do to eliminate it.

About the Presenter 

Robert C. Seacord is the Standardization Lead at Woven Planet, where he works on the software craft. Robert was previously a Technical Director at NCC Group, Secure Coding Manager at Carnegie Mellon’s Software Engineering Institute, and an adjunct professor in the School of Computer Science and the Information Networking Institute at Carnegie Mellon University.

He is the author of seven books, including Effective C: An Introduction to Professional C Programming (No Starch Press, 2020), The CERT C Coding Standard, Second Edition (Addison-Wesley, 2014) Secure Coding in C and C++, Second Edition (Addison-Wesley, 2013), and Java Coding Guidelines: 75 Recommendations for Reliable and Secure Programs (Addison-Wesley, 2014). He has also published more than 50 papers on software security, component- based software engineering, web-based system design, legacy-system modernization, component repositories and search engines, and user interface design and development. Robert has been teaching secure coding in C and C++ to private industry, academia, and government since 2005. He started programming professionally for IBM in 1982, working in communications and operating system software, processor development, and software engineering; he  also has worked at the X Consortium, where he developed and maintained code for the Common Desktop Environment and the X Window System. Robert is on the advisory board for the Linux Foundation and is an expert at the ISO/IEC JTC1/SC22/WG14 international standardization working group for the C programming language.

Team Process Integration: Half-Day Course

Team Process Integration: Half-Day Course

Abstract:

This half-day course covers all aspects of the Team Process Integration (TPI) framework. The TPI methodology integrates disciplined project practices that can be applied by many product teams (e.g., software, systems, and test). It is a framework that provides fundamental engineering processes for the following areas: planning, tracking, quality, measurement and metrics, as well as communicating team status. The TPI method is used at the project level and is applied by individual members of a team to guide daily work.      

This course includes the following topics (each individually available on YouTube):

About the Presenters

Dr. Brad Hodgins is a computer scientist and has been supporting Naval Air Systems Command (NAVAIR) for 36 years. He has over 20 years of experience in developing simulation and avionics software. He has spent the last 16 years as a project planning and tracking coach and instructor for the Performance Resource Team (PRT), actively coaching project teams in the development of high-quality products for on-time, on-budget delivery to the fleet.

Brad views the SEA as an incredible venue to share best practices for planning and tracking software projects and to brainstorm solutions to problems currently affecting the Software Community. He is currently serving as the SEA Membership Coordinator and a member of the SEA Executive Team; he is also a member of the Next-Gen Tooling standing committee.

Jeff Schwalb is a computer scientist and has been supporting Naval Air Systems Command (NAVAIR) since 1984. He has over 20 years of experience developing and acquiring real-time embedded software systems for avionics, weapons, and range instrumentation systems. He also began collaborating with the Software Engineering Institute (SEI), learning and applying CMM key practices, becoming a certified Personal Software Process℠ (PSP℠) instructor and then a certified Team Software Process℠ (TSP℠) coach. Over the last 25 years, he has taught and consulted with hundreds of scientists and engineers in various forms of personal engineering processes and has coached dozens of projects in the launch and operations of team project planning and tracking.

In 2017, Jeff connected with the SEI on the establishment of the organization we know today as the Software Excellence Alliance (SEA). Today, Jeff continues to work within the SEA to identify and establish pragmatic, value-added solutions to problems currently affecting the software community. He is currently serving as a member of the SEA Executive Team and as a supporting member of SEA working groups in areas such as Membership, Agile Community Networking, and Knowledge Transfer.

David Saint-Amand is a Performance improvement coach with the Process Resource Team of the Naval Air Systems Command (NAVAIR).  His previous positions include DCS Corporation Section Manager, Naval Operations Research Analyst, Engineering Geologist, and Seismic Safety Consultant.

He holds a B.A. in Geology from the University of California at Santa Barbara with a secondary emphasis in Computer Science.  He is a Defense Acquisition University Certified Level III Life Cycle Logistician, a Software Engineering Institute (SEI) Certified Personal Software Process (PSP) Developer, an SEI-Authorized PSP Instructor, and a NAVAIR Internal Team Software Process Coach.

Kristianne Aberer has been working for the Performance Resource Team (PRT) of the Naval Air Systems Command (NAVAIR) as a Performance Improvement Coach for the past 3 years. She has helped multiple engineering project teams to plan and track their work so they could deliver high-quality products on cost and on schedule while maintaining a healthy work/life balance. Her previous positions include Electronics Design Engineer, Flight Test Engineer, and Stay-At-Home-Parent. Kristianne holds a B.S. in Mechatronic Engineering from California State University, Chico. Kristianne grew up being very involved in youth sports and had many wonderful coaches. She enjoys paying it forward by coaching youth soccer teams, teaching physical education at a small Montessori school, and coaching elementary students in track and field.