Jazzberry is an AI agent for finding bugs that is driven by real code execution. You can add Jazzberry on GitHub to start automatically getting bug reports on your pull requests.
@skyler_ji, all you have to do is install the bot on your GitHub account (1 click) and then continue making pull requests as per usual. We want to make it as easy as possible.
@justin_lee27 because we clone the repository into a secure sandbox, we do not have to put all your code in the context window. Our AI agent selects which files it wants to look at, just like a human would.
Report
So cool! How do you plan to handle potential false positives as the system evolves?
As we get better at running repositories in a sandbox, we can cut out all false positives by providing evidence that the bugs we find trigger real errors.
Then the question is just about filtering for bugs people actually care about.
Report
How often does it misidentify a bug? Have you had cases where it is wrong?
@new_user___14220253b848d38479d6c03 I think misidentify is the wrong word here. Because we run the code, we can (typically) provide some evidence of the bug existing. However, we have had a few cases where Jazzberry thought that something was buggy when really that was the intended behavior of the system.
That is why we are not a PR blocking tool. We just provide a list of bugs that we think exist, but you are welcome to ignore them.
We are working on adding a way for users to tell Jazzberry the intended behavior so that it does not make the same mistake on future PRs.
Airweave
Jazzberry found bugs in the airweave codebase and made us feel insecure, but Marco and Mateo were nice about it 👍
Jazzberry
@lennertjansen we are just here to help :)
Love @Jazzberry The code review bots seem fantastic. Also, I love the design & UI work and @Jazzberry is great for small bugs. Amazing product!
What's the onboarding process?
Jazzberry
@skyler_ji, all you have to do is install the bot on your GitHub account (1 click) and then continue making pull requests as per usual. We want to make it as easy as possible.
Den
How does it handle complex monorepos tho?
Jazzberry
@justin_lee27 because we clone the repository into a secure sandbox, we do not have to put all your code in the context window. Our AI agent selects which files it wants to look at, just like a human would.
So cool! How do you plan to handle potential false positives as the system evolves?
Jazzberry
@savannah_tynan1 good question!
As we get better at running repositories in a sandbox, we can cut out all false positives by providing evidence that the bugs we find trigger real errors.
Then the question is just about filtering for bugs people actually care about.
How often does it misidentify a bug? Have you had cases where it is wrong?
Jazzberry
@new_user___14220253b848d38479d6c03 I think misidentify is the wrong word here. Because we run the code, we can (typically) provide some evidence of the bug existing. However, we have had a few cases where Jazzberry thought that something was buggy when really that was the intended behavior of the system.
That is why we are not a PR blocking tool. We just provide a list of bugs that we think exist, but you are welcome to ignore them.
We are working on adding a way for users to tell Jazzberry the intended behavior so that it does not make the same mistake on future PRs.
Janus
so hyped!! congrats on launching guys!
Jazzberry
@jw_12 Thank you Jet :)