Add position ids for pretokenized data#430

timofeev1995 wants to merge 2 commits intomaintogethercomputer/together-python:mainfrom

positions-ids-for-tokenized-datatogethercomputer/together-python:positions-ids-for-tokenized-dataCopy head branch name to clipboard