Wa alaikom asalaam Khalid...this affects all of us. You answered part of your own question
The people you hang around with have a LOT to do with it, believe me. Try and surround yourself with brothers who are on the deen and serious about practicing their religion. Remember the hadith where the Prophet (saw) advised that the best of friends are those who help you remember Allah! I can't remember the exact narration, but inchallah I'll find it for you.
Spend some more time reading islamic books...whether the Qur'an, hadith, books on fiqh or other islamic issues....it's all good!! Try and stay away from places and environments you shouln't be in...remember there's a reason why we shouldn't be there!! Do your best to pray on time and wake up for salaatul fajr. That makes such a difference to your day and mindframe, subhanaAllah!!
Don't worry about "losing out" in this dunya...because inchallah you'll be winning in the akhira
