Weave Code
Code Weaver
Helps Laravel developers discover, compare, and choose open-source packages. See popularity, security, maintainers, and scores at a glance to make better decisions.
Feedback
Share your thoughts, report bugs, or suggest improvements.
Subject
Message
Log in Register
Home
Packages
Tokenizer
Release Notes

Tokenizer Laravel Package

theseer/tokenizer

A PHP tokenizer library for parsing PHP source code into tokens, built on top of ext/tokenizer. Used by tools like PHPUnit to analyze code, inspect syntax, and support static analysis, refactoring, and code quality workflows.

View on GitHub
Deep Wiki
Context7
2.0.1
  • Removed the custom token T_AMPERSAND as PHP 8.1+ provides tokens for it already and our 2.0.0 release overwrote it. See #44 for details.

Full Changelog: https://github.com/theseer/tokenizer/compare/2.0.0...2.0.1

2.0.0

What's Changed

Full Changelog: https://github.com/theseer/tokenizer/compare/1.3.1...2.0.0

1.3.1
  • Fix #37: v1.3.0 introduced a breaking change on the token collection (ArrayAccess interface removed)
1.3.0
  • Require at least PHP 7.3 for building, code should still be PHP 7.2 compliant
  • Merge various performance improvements provided by @staabm
  • Merge some code cleanups provided by @staabm
1.2.3

Changed

  • Do not use implict nullable type (thanks @sebastianbergmann), this should make things work on PHP 8.4
1.2.2

Fixed

  • #18: Tokenizer fails on protobuf metadata files
1.1.2

Revert PHPUnit 8 update to stay PHP 7.0 compliant.

This release does not include any functionality change otherwise.

1.1.1

Fixed

  • #1: Empty file causes invalid array read

Changed

  • Tests should now be PHPUnit 8 compliant
1.1.0
  • Allow use of custom namespace for XML serialization
1.0.0
Weaver

How can I help you explore Laravel packages today?

Conversation history is not saved when not logged in.
Prompt
Add packages to context
No packages found.
davejamesmiller/laravel-breadcrumbs
artisanry/parsedown
christhompsontldr/phpsdk
enqueue/dsn
bunny/bunny
enqueue/test
enqueue/null
enqueue/amqp-tools
milesj/emojibase
bower-asset/punycode
bower-asset/inputmask
bower-asset/jquery
bower-asset/yii2-pjax
laravel/nova
spatie/laravel-mailcoach
spatie/laravel-superseeder
laravel/liferaft
nst/json-test-suite
danielmiessler/sec-lists
jackalope/jackalope-transport