Six degree-of-freedom (6-DOF) Flight Simulation Check-cases


Title: Standard Check-Cases for Six-Degree-of-Freedom Flight Vehicle Simulations
Speakers: Dr. Robert Shelton
Mr. Michael Madden
Date/Time: April 21, 2015 (2:00 pm EDT)
Abstract:

The rise of innovative unmanned aeronautical systems and the emergence of commercial space activities have resulted in a number of relatively new aerospace organizations that are designing innovative systems and solutions. These organizations use a variety of commercial off-the-shelf and in-house-developed simulation and analysis tools including 6-degree-of-freedom (6-DOF) flight simulation tools. The increased affordability of computing capability has made high-fidelity flight simulation practical for all participants. Verification of the tools' equations-of-motion and environment models (e.g., atmosphere, gravitation, and geodesy) is desirable to assure accuracy of results. However, aside from simple textbook examples, minimal verification data exists in open literature for 6-DOF flight simulation problems.

The NESC undertook an assessment that compared multiple solution trajectories to a set of verification check-cases that covered atmospheric and exo-atmospheric (i.e., orbital) flight. Each scenario consisted of redefined flight vehicles, initial conditions, and maneuvers. These scenarios were implemented and executed in a variety of analytical and real-time simulation tools. This tool-set included simulation tools in a variety of programming languages based on modified flat-Earth, round-Earth, and rotating oblate spheroidal Earth geodesy and gravitation models, and independently derived equations-of-motion and propagation techniques. The resulting simulated parameter trajectories were compared by over-plotting and difference-plotting to yield a family of solutions. In total, seven simulation tools were exercised.

The check cases and the generated family of solutions are now available for download from the NESC Academy web-site for use in cross comparison with other simulation tools. This webcast will give an overview of the check-cases, the comparison approach, the types of differences remaining in the comparison set, and an introduction to the contents of the “flightsim” website where the check case descriptions and generated results are stored.

Watch Now

This directory contains links to retrieve the models and resulting data for both atmospheric and orbital flight simulation benchmarks as described in the NASA Engineering and Safety Center Report No. NESC-RP-12-00770, "Check-Cases for Verification of 6-DOF Flight Vehicle Simulations" as well as AIAA 2015-1810, "Further Development of Verification Check-cases for Six-Degree-of-Freedom Flight Vehicle Simulations."

The purpose of this study was to compare multiple solution trajectories to a set of verification check-cases that covered atmospheric and exo-atmospheric (i.e., orbital) flight. Each scenario consisted of pre-defined flight vehicles, initial conditions, and maneuvers. These scenarios were implemented and executed in a variety of analytical and real-time simulation tools. This tool-set included simulation tools in a variety of programming languages based on modified flat-Earth, round-Earth, and rotating oblate spheroidal Earth geodesy and gravitation models, and independently derived equations-of-motion and propagation techniques. The resulting simulated parameter trajectories were compared by over-plotting and difference-plotting to yield a family of solutions.

This web page contains the reports as well as the models and datasets generated by them that were used in the reports. They are made available here in a digital form to facilitate comparison with other simulation tools.

For more information, please contact Dr. Robert Shelton <robert.o.shelton@NASA.gov> at NASA Johnson Space Center, (281) 793-5270.

Reports

A two-volume NESC report has been prepared that describes the process of and the results of comparing several NASA and one open-source flight simulation tools; a link is given below. Two AIAA conference papers were also generated during the course of this assessment and are given below as well.

An interim AIAA conference paper (AIAA 2013-5071) describes the project with some initial results, but some of the checkcase initial conditions and scenarios have changed.

An follow-on AIAA conference paper (AIAA 2015-1810) provides a nice summary of the comparison effort with some example resuults.

The final paper, NASA/TM-2015-218675: "Check-Cases for Verification of 6-Degree-of-Freedom Flight Vehicle Simulations," appears in two volumes.

Volume I
is an executive summary spanning 31 pages and provides an overview of the process and results.
Volume II
runs 614 pages and contains the detailed results of the study, including information about the simulated models, initial conditions, maneuvers, cross- and difference-plots, and discussion of detected differences.

Models

There are seven models provided for use in these various checkcases. These models are encoded using DAVE-ML, an AIAA-developed XML grammar for exchanging dynamic models. (See the DAVE-ML website for more information about this format.) Signal / variable names are encoded according to ANSI/AIAA-S-119-2011, "Flight Dynamics Model Exchange Standard," available from the American Institute of Aeronautics and Astronautics.

Atmospheric check-case models (all atmospheric models in a single .zip file), including

  • Atmospheric spheroid
  • Tumbling brick
  • F-16 aircraft
  • Two-stage rocket

Orbital check-case models (all atmospheric models in a single .zip file), including

  • Orbital spheroid
  • Cylinder
  • Space station

All models in a single .zip file

Initial Conditions

All initial conditions as a Microsoft® Excel .xlsx spreadsheet

Trajectory Data

  • Atmospheric Check-cases (or all atmospheric check-cases in a single 24.9 MB .zip file)
    • Atmospheric case 01: Dropped Sphere, dragless (WGS-84 earth) (.zip file)
    • Atmospheric case 02: Tumbling Brick, no damping (.zip file)
    • Atmospheric case 03: Tumbling Brick, rotational damping (.zip file)
    • Atmospheric case 04: Dropped Sphere (Stationary round earth) (.zip file)
    • Atmospheric case 05: Dropped Sphere (Rotating round earth) (.zip file)
    • Atmospheric case 06: Dropped Sphere (WGS-84 earth) (.zip file)
    • Atmospheric case 07: Dropped Sphere, steady wind (WGS-84 earth) (.zip file)
    • Atmospheric case 08: Dropped Sphere, wind shear (WGS-84 earth) (.zip file)
    • Atmospheric case 09: Eastward Fired Cannonball (.zip file)
    • Atmospheric case 10: Northward Fired Cannonball (.zip file)
    • Atmospheric case 11: F-16 Subsonic trim flyout (.zip file)
    • Atmospheric case 12: F-16 Supersonic trim flyout (.zip file)
    • Atmospheric case 13.1: F-16 Subsonic altitude change (.zip file)
    • Atmospheric case 13.2: F-16 Subsonic airspeed change (.zip file)
    • Atmospheric case 13.3: F-16 Subsonic heading change (.zip file)
    • Atmospheric case 13.4: F-16 Subsonic lateral step (.zip file)
    • Atmospheric case 15: F-16 circling north pole (.zip file)
    • Atmospheric case 16: F-16 circling equator/IDL (.zip file)
    • Atmospheric case 17: Unguided two-stage rocket launch (.zip file)
  • Orbital Check-cases (or all orbital check-cases in a single 11.1 MB .zip file)
    • Orbital case 02: ISS orbit propagation (.zip file)
    • Orbital case 03A: ISS orbit in 4 x 4 gravity (.zip file)
    • Orbital case 03B: ISS orbit in 8 x 8 gravity (.zip file)
    • Orbital case 04: Planet Ephemeris (.zip file)
    • Orbital case 05A: Atmosphere modeling 1 (.zip file)
    • Orbital case 05A: Atmosphere modeling 2 (.zip file)
    • Orbital case 05A: Atmosphere modeling 3 (.zip file)
    • Orbital case 06A: Sphere with fixed drag (.zip file)
    • Orbital case 06A: Sphere with dynamic drag (.zip file)
    • Orbital case 06A: Cylinder plane change (.zip file)
    • Orbital case 06A: Cylinder departing Earth (.zip file)
    • Orbital case 07A: Sphere 4x4 grav + 3rd body pert (.zip file)
    • Orbital case 07B: Sphere 8x8 grav + 3rd body pert (.zip file)
    • Orbital case 07C: Sphere 4x4 + 3rd body + drag (.zip file)
    • Orbital case 07D: Sphere 8x8 + 3rd body + drag (.zip file)
    • Orbital case 08A: ISS free rotation, nil rate (.zip file)
    • Orbital case 08B: ISS free rotation, initial rate (.zip file)
    • Orbital case 09A: ISS torqued, nil rate (.zip file)
    • Orbital case 09B: ISS torqued, initial rate (.zip file)
    • Orbital case 09C: ISS torque + force, nil rate (.zip file)
    • Orbital case 09D: ISS torque + force, initial rate (.zip file)
    • Orbital case 10A: Cyl in circ. orb. + grav. gradient, nil rate (.zip file)
    • Orbital case 10B: Cyl in circ. orb. + grav. gradient, initial rate (.zip file)
    • Orbital case 10C: Cyl in ellip orb. + grav. gradient, nil rate (.zip file)
    • Orbital case 10D: Cyl in ellip orb. + grav. gradient, initial rate (.zip file)
    • Orbital case FULL: ISS responding to all effects (.zip file)

Link Annotations

The "Specifications" menu at the top contains descriptions of the simple body models used in this assessment and a complete listing of simulation output parameters, frames, and definitions.

The "References" menu at the top contains links to additional information helpful in using the checkcases, map projections and a quaternion to euler transformation.

The "Atmospheric" and "Orbital" menus at the top contains all the 2015 checkcases, descriptions, raw data files from each of the participating simulations and an interactive plotting feature that allows users to upload their own simulation output data for quick comparison to the other simulation outputs.

Lastly, the "2023 Assessment Website" menu is a link to the 2023 NESC Assessment that compared simulations for a variety of Lunar checkcases.

Errata

An Errata was added to the top of each 2015 volume to address a list of errors found in the original reports. Specific erratum can be found at the bottom of the relevant pages of this website in the Specifications, Atmospheric, and Orbital menus. These Errata sections list corrections made on the website that reference one of the errata in the report. Superscripts are used to annotate the corrected sections with hyperlinks to their respective erratum.