Split string by multiple delimiters

[apoo...@thoughtworks.com]

I have a string "hello <format> world" and I need to split it based on multiple characters "<> ". How do I get this ?

One option is: 

strings.FieldsFunc("hello <format> world", func (r rune) bool {

      return r == '<' || r == '>'
   })

But this gives ["hello","format","world"].

Is there a way to retain even the delimiters also in this list?

[Kevin Malachowski]

If your use case really is that simple you could just manually range over you're string and do whatever you need to do yourself. Look at the source for strings.Split and the like for a starting place if you need one.

[C Banning]

http://play.golang.org/p/PTqUFl2cjE

[speter]

Another take using bufio.Scanner:
https://play.golang.org/p/gZFodmTXtS

Peter

--
You received this message because you are subscribed to the Google Groups "golang-nuts" group.
To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[sab...@gmail.com]

On Thursday, January 8, 2015 at 4:57:25 PM UTC-5, speter wrote:

Another take using bufio.Scanner:
https://play.golang.org/p/gZFodmTXtS

Very cool!  Works in the playground but locally (both linux & win32) I get "panic: bufio.Scan: 100 empty tokens without progressing"

[Jian Zhen]

yet another way

http://play.golang.org/p/X779Liy5bN

[András Pálinkás]

What about regexp.Split?

If speed doesn't matter, that's the easiest, most expressive in code.

http://golang.org/pkg/regexp/#Regexp.Split

[András Pálinkás]

Sorry, this is not good, I've just realized you also want to retain the delimiters.

[speter]

Oh, I missed one case... This one should work:
https://play.golang.org/p/UWdQPs3P-W

It seems the bug is triggered on 64bit but not on 32bit (or amd64p32 on which the playground is supposed to run), not quite sure why.

Peter

[Michael Monashev]

Hi, speter.

> Another take using bufio.Scanner:
> https://play.golang.org/p/gZFodmTXtS

Why did you write:

func (d delimiters) split(data []byte, atEOF bool) (advance int, token []byte, err error) {

and after convert data to string:

i := strings.IndexAny(string(data), string(d))

?

May be better this:
func (d delimiters) split(data string, atEOF bool) (advance int, token []byte, err error) {
i := strings.IndexAny(data, string(d))

or

func (d delimiters) split(data *string, atEOF bool) (advance int, token []byte, err error) {
i := strings.IndexAny(*data, string(d))

?

--
Michael

[yy]

You really want d.split to be a SplitFunc, so you can pass it to
scanner.Split in line 31 (see the documentation of the bufio package).
But if you want to avoid the conversion to string, you can use
bytes.IndexAny instead of strings.IndexAny.


--
- yiyus || JGL .