feat: use regular tokenizer in static embedding, add max length#3541
Open
stephantul wants to merge 2 commits intohuggingface:mainfrom
Open
feat: use regular tokenizer in static embedding, add max length#3541stephantul wants to merge 2 commits intohuggingface:mainfrom
stephantul wants to merge 2 commits intohuggingface:mainfrom
