Stream: t-compiler

Topic: Jointness in TokenStream


matklad (Sep 25 2019 at 08:27, on Zulip):

@Vadim Petrochenkov while working on jointness-preserving mbe, I've noticed that proc macro tt stores jointness as a field of Token, while libsyntax::TokenStream stores jointness as TreeAndJoin. Do you think it might make sense to move jointness to the Token in libsyntax as well? That certainly would make it harder to lose jointness along the way, and should be easier to work with, as matching (tree, is_joint) tuple is awkward.

Vadim Petrochenkov (Sep 25 2019 at 10:03, on Zulip):

Do you think it might make sense to move jointness to the Token in libsyntax as well?

Yes, I think that makes sense.

Vadim Petrochenkov (Sep 25 2019 at 10:06, on Zulip):

I thought about it when implementing #61541, and wanted to do it myself later, but it didn't happen.

Vadim Petrochenkov (Sep 25 2019 at 10:07, on Zulip):

IIRC, it doesn't even increase the size of Token, but I'm not sure.

Last update: Nov 22 2019 at 04:30UTC