It depends on your use case. Full conversational speech recognition can't adequately fit in memory on a mobile device, but smaller packages like PocketSphinx can. Kaldi, also mentioned in the comments, can serve various use cases, but again it's limited by the lexicon size. If we're talking Google or Siri-level, it's not fitting onto a device in the near future.