Bilingual-gpt-neox-4b: Report