Kane

Where is ChatGPT's limit? How can it create a unique barrier when developing native AI applications?

byβ€’
If the unique feature of native AI applications is just "using AI interfaces", do they still matter?
11 views

Add a comment

Replies

Best
Oleksandr Koreniuk
Chat GPT limit lies in 1) the Attention window, which is some thousands of characters afaik and 2) it fails to elaborate and modify constrained hierarchical data correctly, in the example source code tree. These problems cannot be overcome in the current stage of Tech.
Kane
@oleksandr_koreniuk In fact, I have seen at least two methods on GitHub to solve the input length problem: one is to build a side vector database to store knowledge, and bring the data related to the request each time; the other is to enter in segments, summarizing the previous content and adding the current content each time. I believe that the length problem will be solved. πŸ’ͺ
Oleksandr Koreniuk
@blueeon if you would make it to modify source code repositories - you are gold. Right now , as far as i learnt, for current state of algorithms there is not enough compute power on earth for medium size source code repositories
Kane
@oleksandr_koreniuk Your statement is not wrong. The two methods i mentioned have optimized the input and do not require complete knowledge to obtain answers in a Q&A scenario. There is a technique called Embeddings, and OpenAI provides an API for Embeddings, which can be used to create side vector databases. Another practical example is Stripe, which used GPT-4 to enhance the natural language search capability of its development documentation: https://docs.google.com/forms/d/.... I hope this can be helpful for your reference.