Skip to content

Frontend improvement #125

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Fosowl opened this issue Apr 19, 2025 · 26 comments
Open

Frontend improvement #125

Fosowl opened this issue Apr 19, 2025 · 26 comments
Assignees
Labels
enhancement New feature or request medium priority

Comments

@Fosowl
Copy link
Owner

Fosowl commented Apr 19, 2025

Enhance the current design: Improve the UI/UX to improve usability, aesthetics, and user experience.

Fix duplicate message bugs: Resolve issues causing duplicate messages to appear in the frontend.

Improve browser screenshot streaming: The currently approach for streaming of screenshots is probably wrong and kind of glitchy.

Enhance editor view: Improve the functionality and user experience of the editor view, fix bugs.

Fix status message updates: Address the issue where status messages are not being updated correctly by agents.

Add markdown support for left pane view.

More readable command/code output.

@Fosowl Fosowl added the help wanted Extra attention is needed label Apr 19, 2025
@Saminu
Copy link

Saminu commented Apr 21, 2025

I can help with this, happy to contribute in the front end UI/UX side

@Fosowl
Copy link
Owner Author

Fosowl commented Apr 21, 2025

great! I have just merge some slight change change so you might want to update your fork. I couldn't fix the duplicate answer problem (that ususally happen when browsing the web), despite having this condition to check if a message exist before adding it:

        const answerExists = messages.some(
            (msg) => normalizeAnswer(msg.content) === normalizedNewAnswer
        );

I think it's a weird concurrency / useEffect bug ? Haven't really dig into it so much, would be very nice if know how to fix this!

Perhaps you can join the discord ? Good luck!

@Fosowl
Copy link
Owner Author

Fosowl commented Apr 21, 2025

also feel free to improve the design as you like.

@Fosowl Fosowl changed the title Frontend improvement [Web dev needed] Frontend improvement Apr 21, 2025
@Saminu
Copy link

Saminu commented Apr 21, 2025 via email

@Fosowl
Copy link
Owner Author

Fosowl commented Apr 21, 2025

I am sorry, maybe I am misunderstanding but you can't use a UI elements you did for another project and apply it to this project. So could you clarify how you would contribute ? the frontend is mostly done, it's just bug fixes and improvement of the overall design that are needed, not a rewrite.

Secondly, why would i listen to a random podcast about manus ? the link is not working but i don't understand why you are promoting this.

@Saminu
Copy link

Saminu commented Apr 21, 2025

Never mind the podcast, It's thesame UI really, was typing on my phone. Attached is an image of the Frontend Improvement I suggest using the learning from my previous work

Image

@Saminu
Copy link

Saminu commented Apr 21, 2025

Introduced a task based tab approach as opposed to just a simple chat based interface, use that to keep track of background task a they run.

@Fosowl
Copy link
Owner Author

Fosowl commented Apr 21, 2025

Okay that clear it up. It look really good. How would the task tab work exactly? Sound like a nice idea but should take less space (or have button to hide it)

Also, it's just a suggestion but for the design I was thinking it would be cool to take some inspiration from Jarvis:
https://www.youtube.com/watch?v=EfmVRQjoNcY
Like from 0:12 to 0:18 seconds you can have a glance at the interface. Having a similar color theme, with transparency and animation (like the browser window could move over the editor windows in a way thats similar to how the youtube page move over stock market data in the video) but again just an idea I had, if that's additional work you don't want to do I totally understand, just sharing some of the inspiration I had in mind for the design.

@Saminu
Copy link

Saminu commented Apr 21, 2025

Task are generally what messages lead to, and most use cases for such agent involves running background task behind the scene. So most messages should be task like message from the users i.e. "Generate a travel plan for 4 days in Paris", "Build me a comprehensive report on topic ABC". similar to Manus. With regards to the video, I can't seem to open it, but I get what you mean. However, the UI for Jarvis is less functional and more connected to a AR/VR world

@Fosowl
Copy link
Owner Author

Fosowl commented Apr 21, 2025

Yes, I understand so by background tasks you mean all the processing of the agent until it come to an answer (like the interaction with code interpreter until success or all the navigation steps on the web), right?
Would be more convenient on discord, but the video title is "Iron Man 2 | Welcome home sir (Workshop scene)" and from 12 to 18 seconds it's a interface that closer to some fancy OS UI than AR/VR.

@Fosowl
Copy link
Owner Author

Fosowl commented Apr 21, 2025

I am merging your pull request

@Saminu
Copy link

Saminu commented Apr 21, 2025

Perfect

@Fosowl Fosowl removed the help wanted Extra attention is needed label Apr 26, 2025
@Fosowl
Copy link
Owner Author

Fosowl commented Apr 27, 2025

Hey, I have temporarily removed the task "panel" from App.js so that users can already enjoy the new frontend design, also I have added a updateData function that I call within the fetchLatestAnswer, this is because otherwise the command/code blocks would not display in the editor view when planner agent is working. This required change on the backend as well (mostly specific to agents, mostly no change on api.py).
You could override these change, but just make sure that the code/command blocks in the editor view update in real time on the frontend when the planner agent is working.
Any task that require multiple agents should use the planner agent, for example : "search the project agenticSeek on github, find the download link, clone it and follow the readme to install".

@Saminu
Copy link

Saminu commented Apr 29, 2025

Fantastic, I will have a look through it in the next few days. many thanks

@ziryge
Copy link

ziryge commented May 5, 2025

is it possible if someone can help me install and run the api.py model because its not working, i can only run with the cli.py, something with selenium error.

@Fosowl
Copy link
Owner Author

Fosowl commented May 5, 2025

@ziryge You need to raise an issue with specific information about your OS, and the complete error message. Possibly the .logs/browser.log as well

@ziryge
Copy link

ziryge commented May 6, 2025

Hello @Fosowl,

I hope this message finds you well. I recently developed an AI model inspired by your work, built entirely from scratch without referencing or reusing code from your repository. I aimed to ensure originality in the implementation while aligning with similar principles.

Would it be possible for you to briefly review the project and share your insights on its competence? I deeply respect your expertise and would greatly value any feedback to improve the model’s quality and robustness.

p.s i will update it in 30 minutes so you can use it.

@Fosowl
Copy link
Owner Author

Fosowl commented May 6, 2025

Hello, you will need to ask me on discord, this is the thread for the frontend. I can take 5 minutes to quickly look at the code but I won't do consulting.

@ziryge
Copy link

ziryge commented May 6, 2025

@Fosowl What is your discord?

@ziryge
Copy link

ziryge commented May 6, 2025

@Fosowl btw my ai is in my repo you can check it out from my account (its public) i made it prpiatary license but i will give you on with mit you can see if there are things that can help!

@Fosowl
Copy link
Owner Author

Fosowl commented May 6, 2025

click the join discord button in the readme

@ziryge
Copy link

ziryge commented May 6, 2025

@Fosowl ok i will but currently i am in school so i will join when i go home (im in middle school)

@ziryge
Copy link

ziryge commented May 6, 2025

@Fosowl If you think that my code is good can you please promote me.

Repository owner deleted a comment from ziryge May 6, 2025
@Fosowl
Copy link
Owner Author

Fosowl commented May 6, 2025

I won't promote you, now you should stop spamming this conversation which is for the frontend only.

@Fosowl
Copy link
Owner Author

Fosowl commented May 16, 2025

@Saminu Hi, are you still on the task ? I have added markdown support on the frontend and will likely integrate other small change. I was also thinking about adding a stop button. It would be better if we could coordinate on the discord.

@zuberkhan01st
Copy link

Hey I would like to contribute and improve the design, as currently it looks quite simple. Can you assign this issue to me?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request medium priority
Projects
None yet
Development

No branches or pull requests

4 participants