The LORD said to Gideon, The people with you are too many for me to give the Midianites into their hand, lest Israel boast over me, saying, My own hand has saved me. Judg. 7:2 ESV 

Gideon started out with thirty-two thousand men but ended up with three hundred at the start of the actual battle. God Himself took them away and separated them from him. Gideon was not abandoned, and it was completely God’s will for this to happen. In fact, it was God’s plan.

God likes to be outnumbered, He prefers it this way. When the enemy comes in like a flood, God will cause you to stand through it and everyone looking on will have to say that this is the work of God. 

You may set out to do something with a terrific group of people, and then find that it is just you and a handful left. This is probably no accident. God has plans to make you shine and He has placed the ones around you that need to be, and removed the rest. You will come through this and everyone will know that the Lord is with you, just do not turn back.