This sample Android app demonstrates having a debug-build-only diagnostic overlay in an application (akin to the red flash you can enabled for StrictMode violations).

This app is covered in the chapter on in-app diagnostics in The Busy Coder's Guide to Android Development.