Jeremy: Will an Artemis III orbital demonstration mission succeed by the end of 2027?

Obtaining outside data.
Checking internet sources, using keywords: Artemis III orbital demonstration 2027
News from various sources:

The NASA Artemis III mission, scheduled for the summer of 2027, aims to test the docking procedures between the Orion spacecraft and two prototype lunar landers developed by Blue Origin and SpaceX in low Earth orbit. This mission marks a crucial step in NASA’s preparations for future crewed lunar landings, specifically the Artemis IV mission planned for 2028 to the Moon’s south pole.

Artemis III will involve a complex operation consisting of three separate rocket launches and two docking demonstrations over a 14-day period, extendable to 17 days. The mission will carry four astronauts: NASA astronauts Randy Bresnik, Frank Rubio, and Andre Douglas, along with European Space Agency astronaut Luca Parmitano. The astronauts will first test Blue Origin’s Blue Moon lander, then shift to SpaceX’s Starship lander for docking tests, without entering it.

The mission is especially significant as it addresses the need for in-orbit refueling, a capability critical for SpaceX’s Starship, which has yet to be demonstrated. The results from this mission will help refine spacecraft systems and operational procedures for future missions, which will involve lunar landings and establishing a sustainable human presence on the Moon.

Following the docking tests, additional experiments will be conducted aboard Orion to prepare for deep-space missions, including testing life-support systems and other technologies vital for long-term lunar expeditions. These operations are part of NASA’s strategy to support sustained exploration of the lunar south pole and to potentially use resources found there, such as frozen water, for future missions.

Despite challenges, including a significant setback when Blue Origin’s New Glenn rocket exploded in 2026, NASA is coordinating with its partners to resolve these issues and remain on track for a 2027 launch. Overall, Artemis III represents a critical rehearsal that will provide valuable data needed for the ultimate goal of a crewed lunar landing and eventual missions to Mars.

Fact-checked summary:
The NASA Artemis III mission is scheduled for the summer of 2027, which is crucial for evaluating its success by the end of that year. The mission aims to test docking procedures between the Orion spacecraft and two prototype lunar landers from Blue Origin and SpaceX in low Earth orbit, a critical objective. The complex mission profile involves three separate rocket launches and two docking demonstrations over 14 to 17 days, impacting its likelihood of success. Astronauts will test docking with Blue Origin’s Blue Moon lander and SpaceX’s Starship lander, without entering them, which is important for future mission planning. In-orbit refueling for SpaceX’s Starship is yet to be demonstrated, a critical technology challenge. The mission will refine spacecraft systems and procedures for lunar landings and a sustainable Moon presence, aligning with NASA’s long-term goals. Additional experiments aboard Orion will prepare for deep-space missions, including testing life-support systems essential for future Moon and Mars expeditions. Artemis III is critical for providing data for lunar landings and eventual Mars missions, emphasizing the mission’s core rationale.

OpenAI gives a base rate of 40%

The question difficulty is rated 8 (0 to 10)

Historical weighted factors include:
Previous success of NASA Artemis missions, 0.3
Reliability of Blue Origin launches, 0.2
Success rate of SpaceX launches, 0.3
Historical docking procedure success, 0.2

A Bayesian calculation could be performed as follows:
P(A) = 0.3 * 0.9 (Artemis success) + 0.2 * 0.8 (Blue Origin) + 0.3 * 0.6 (SpaceX) + 0.2 * 0.75 (docking) = 0.77 (77%) (Carolyn‘s note: LibreOffice gives 0.76 (76%))

Bayesian base rate: 77%

Sufficient news to provide a good forecast? 1 (0 or 1)

News is relevant, topical and unbiased? 1 (0 or 1)

Question classification: scenario_based_forecast

Expected time (days) until question close: 426

The following were considered in order to produce this base rate:
The base rate is derived from an analysis of similar complex space missions, weighted heavily by previous success and reliability of the entities involved in the Artemis III mission. Given the complexity and criticality of the in-orbit docking and refueling maneuvers, the base rate considers the historic rates of success in such activities.

Ideally, the news feed would contain the following sorts of information for a better forecast:
A more detailed review of progress on the in-orbit refueling technology and any updates on the preparation status of the Blue Origin and SpaceX landers would improve forecast accuracy.

Some potential divergent considerations that might affect the base rate:
The main factor that could cause a divergence from the base rate is the need for an unproven in-orbit refueling, which introduces uncertainty. Additionally, each separate launch brings its own risks of failure which can compound.

The following chain of events are necessary for the question to resolve positively:

Successful launch of the Orion spacecraft (highly likely)
Successful launch of the Blue Origin Blue Moon lander (likely)
Successful launch of SpaceX’s Starship (moderately likely)
Successful docking procedures between Orion and the Blue Moon lander (moderately likely)
Successful docking procedures between Orion and SpaceX’s Starship (moderately likely)
Demonstration of in-orbit refueling for SpaceX’s Starship (uncertain)

Querying Claude (AI predicts: 0.08 – confidence: 4)
Querying OpenAI (AI predicts: 0.45 – confidence: 5)

Explanations of the measures below: Guide to Jeremy Lichtman’s Multi-AI Oracle Reports
Question Type: Binary
Median from LLMs: 0.27
Base rate: 0.4 (from OpenAI)
SD: 0.19
MAPD: 0
Confidence: 4.5
Conf Mode: Low
Mellers: 0.19
Reverse Mellers: 0.34
Theory of Mind: 0.175 (What did the LLMs think other LLMs predicted?)
Beta Distribution: 0.79
Close Type: B (B = cautious # closer to 50%; A/C = closer to extremes)
LLM responses: 2

Model value: 27%

The Artemis III mission scheduled for summer 2027 faces significant challenges that could hinder its success by the end of 2027. These challenges arise from the need for successful execution of multiple interdependent tasks, including the launches of the Orion spacecraft, Blue Origin’s Blue Moon lander, and SpaceX’s Starship, along with critical operations like docking procedures and in-orbit refueling, the latter being a yet-to-be-demonstrated technology. The likelihood of success is limited by historical delays with Artemis missions and a low base rate for on-time completion of NASA mega-projects. However, the probability calculations rely on several assumptions that could shift if, for instance, NASA has made unintended progress, or if SpaceX’s rapid iteration impacts development. Moreover, the mission’s success might be tied to a looser definition, allowing for partial successes. Despite inherent risks, some predict that adjustments in mission scope or advances in technology could increase the odds of meeting the deadline.

Runtime: 108 seconds.