Charity Majors has described observability as:

Can you understand whatever internal state the system has gotten itself into? …just by inspecting and interrogating its output? …even if (especially if) you have never seen it happen before?