Prompt phonon signals from particle interactions in Si crystals