Factor out string stream re-splitting as StreamSplitter
authorAlexey Spiridonov <lesha@fb.com>
Thu, 8 May 2014 00:43:51 +0000 (17:43 -0700)
committerChip Turner <chip@fb.com>
Fri, 25 Jul 2014 16:06:01 +0000 (09:06 -0700)
commitdbcb08a7704f91f03e21db723990592f0df7f5a2
tree30b3ec6b824dfcd5fb035e7c7980a69e7fb78ca9
parentce5e83f4c897dee859abb01a84d57559538a8628
Factor out string stream re-splitting as StreamSplitter

Summary: This way I can reuse it in Subprocess. It also makes it easy to make a bunch of other convenient tokenization routines (e.g. delimiter-preserving folly::gen tokenizers, file tokenizers, etc, etc).

Test Plan: fbconfig folly/gen/test && fbmake runtests

Reviewed By: tjackson@fb.com

Subscribers: vkatich, tjackson

FB internal diff: D1317973
folly/gen/String-inl.h
folly/gen/String.h
folly/gen/test/StringTest.cpp