Maze
-
Posts
161 -
Joined
-
Last visited
Posts posted by Maze
-
-
10 minutes ago, Volin said:
Joking aside: I love your project more and more, hope you can figure out the problem quickly. (Quick in terms of said free time, not in terms of availability).
Thumbs are pressed
Thanks, I think this issue was caused by the device that currently runs the script that writes the raw API data to my database as well as the notification bot (which didn't stop working). I am currently looking into different options to run the scripts on either a raspberry pi, cloud server or the server of someone I know, but I will have to make some adjustments first.
-
Bad news everyone, my scipt somehow stopped again, without even sending an error message and the data for the last 13 hours was lost as I only realized it just now... Sorry about that.
-
Just now, Cocofang said:
The "value" of boosters would also have to consider the distribution of rarity, right? A shaman for example makes a booster much more valuable because it is just an uncommon than an equally expensive ultra rare. Or is that not the case because the uncommon pool is bigger than the ultra rare pool? Don't know, I am not a statistician
It does consider the distribution of rarity, the algorithm to calculate the average booster value from the prices isn't that complex.
-
1 hour ago, Mynoduesp said:
This seems like a bug: Booster values 0.
On 12/28/2020 at 11:31 PM, Maze said:After not working again today, I tried to fix another bug related to the data size.
I only managed to partly fix it, so for now the noteworthy prices will only be available on the specific card pages. The price infos on the Cards and Boosters page will display values of 0 for now.
Haven't thought of a good fix for this yet. One comes to mind, but that would only fix the prices for the current values not the mean values. If you think that is good enough, I will implement that... And... I just though of how I could fix it for the min and max prices on the cards page too and maybe even the mean prices, which would even solve the problem of the data size being too big to load/operate on for the future and allow for more features for the notification bot. I will try to do the neccessary adjustments tomorrow/next week.
Mynoduesp likes this -
I just noticed that I forgot to set the invitation link to never expire. I updated the link in the main post, so you are able to join again.
Sorry for the inconvenience to everyone who tried to join so far.
-
2 hours ago, Maze said:
Edit:
I will probably add the feature to pre set this max. display value with a url query, like for the card filters, later, shouldn't take long, so if you set bookmarks you dont need to set it every time.
This is now implemented. Enjoy!
-
-
On 12/31/2020 at 2:08 PM, Mynoduesp said:
@Maze Another thing I've noticed is following inconvinience. If a card somewhen had a huge spike in price the graph doesnt resize even with the abnormaly large price out of the timespam. (Example: https://smj.herokuapp.com/cards/dreadnought)
I finally got to it, but I didn't look too deep into how it adjusts automatically, so I just implemented something so you can set the max value yourself.
Edit:
I will probably add the feature to pre set this max. display value with a url query, like for the card filters, later, shouldn't take long, so if you set bookmarks you dont need to set it every time.
Mynoduesp likes this -
10 minutes ago, Ultrakool said:
Is it me or are there some cards missing? I couldnt find enlightenment for example.
All cards except for the Snapjaws (Promo) [R] are listed.
Enlightenment:
https://smj.herokuapp.com/cards/enlightenment
Maybe you just selected incorrect filters.
-
49 minutes ago, Maze said:
I am updating some stuff on the database right now (correct id for lord-cyrian, displaying prices for santa), so please wait a couple of minutes.
Site is working again, with said adjustments.
Also I exported the full raw data for december and the size is bigger than expected with 380MB for the 13 days I stored the raw data for. For comparison, the full adjusted price data that is currently displayed on my site only takes up 17.5MB.
I will have to make some adjustments for january, since the database that I use has a limit of 512MB for each cluster, but I will probably just split the data and create another cluster for each month.
Volin likes this -
1 minute ago, Cocofang said:
Site just died.
I am updating some stuff on the database right now (correct id for lord-cyrian, displaying prices for santa), so please wait a couple of minutes.
Cocofang likes this -
14 minutes ago, Mynoduesp said:
@Maze Another thing I've noticed is following inconvinience. If a card somewhen had a huge spike in price the graph doesnt resize even with the abnormaly large price out of the timespam. (Example: https://smj.herokuapp.com/cards/dreadnought)
I am aware of this as well, it is an issue with the charts plugin. might potentially be fixed quite easily, but I haven't looked into it, as I plan to use a different plugin for displaying the charts in the future, but I will look into it nonetheless.
14 minutes ago, Mynoduesp said:I'll be reporting such minor issues (like the image) whenever I come across one, Sorry for being a pain in the ass
Thanks and no problem, you are not being a pain in the ass. I am happy to see that my site is used and doesn't fade into oblivion. xD
fiki574 likes this -
3 hours ago, Mynoduesp said:
Not sure if its a bug of SMJ or something else, but `Lord Cyrian` has still a promo card (star in the top left corner) after it was downgreaded from promo to ultra-rare.
Makes the whole site litteraly unusable.
I am aware of this issue. "Lord Cyrian" is already grouped under Ultra Rare though and not under Promo anymore. I need to update the id from "lord-cyrian-promo" to "lord-cyrian" at a few locations in my database, but I haven't done that yet. As for the image, I am still using the images from the cardbase which only has a promo image of it (same with not having easter egg image and others), but I already have something planned, so just wait a bit more.
Mynoduesp likes this -
Hey everyone,
I have something new that I want to share with you.
In the last two days I tried something new and built a simple Discord Bot that allows you to set notifications for card prices.
DISCLAIMER:
Please note that to use the automated notifications you will have to subscribe to the bot, meaning that you need to confirm that your publicly visible Discord ID and all your personal notification settings for this bot are stored in one of my databases. You can unsubscribe at any time, which deletes all your user data including all notification settings for this bot from the database, never to be recovered.
Here are some things it can do right now:
- Set multiple notifications for different cards with criteria for when there are buyout prices below (for buying) or only buyout prices above (for selling) a set price available
- Unset all notifications for a specific card, so you can set new ones, if your criteria change
- Unset a specific notification
- Show all your current notification settings
- Show all current buyout prices for the cards you have set notifications for
- Show all current buyout prices for a specific card, or cards that include a specific set of characters (no subscription needed)
I set the Bot up so that it checks for new data frequently and sends notifications each time a previously set criteria is met, which should be not later than 1.5 minutes after new data is available from the API.
If you are okay with subscribing, just want to use it for displaying the buyout prices of a card or simply want to stay updated on changes to my website or bot, join my myDiscord Server and start interacting with the bot in your DMs. If you joined the server, when the bot was not online, simply DM the bot with !help once it is online again. You can join it here:
Also, since I haven't spent a lot of time with programming this little bot (or Discord Bots in general) yet, there might still be some issues and other stuff, like a not so understandable command documentation or the nonexistent description on my Discord server.
Nonetheless, I hope you still like it and find this simple bot useful.
Alishmass, ulvfdfgtmk, fiki574 and 7 others like this -
After not working again today, I tried to fix another bug related to the data size.
I only managed to partly fix it, so for now the noteworthy prices will only be available on the specific card pages. The price infos on the Cards and Boosters page will display values of 0 for now.
This issue originates from the database that I use, as the full data size has become too big for it to operate on. Apart from that, I did some calculations and the size for the specific cards should stay small enough for quite some time for the database to still work... so there shouldn't be any issues there, hopefully.
Nonetheless, I will try to come up with a solution for the problem, but I plan to switch to a different database anyways, so I might just continue working on the overhaul with the new database instead. Also, I hope that the new database won't run into such problems.
Mynoduesp likes this -
The site is working again. Enjoy!
Volin and MephistoRoss like this -
I put together a temporary API of my own, with parts of the data that I use on my site. Note that the structure and the contents are only temporary and subject to change!
If you are interested, you can find the API here: https://smj.herokuapp.com/api/temporary
-
The site is temporarily going to display no price data, as there is too much data for the site to load, I will work on a workaround today. Also, no data will be lost!
Apart from that I put together a temporary API with parts of the data that I use on my site. Note that the structure and the contents are only temporary and subject to change!
If you are interested, you can find the API here: https://smj.herokuapp.com/api/temporary
Edit: Despite what I said, some data was lost, not because of was I was working on (which isn't finished yet, so please be patient), but because the device that runs the script to write the data from the auction API to my database froze and I didn't realize it for a few hours...
I will try find a better solution and put in some backup scripts, so that this hopefully won't happen again...
Mynoduesp and RuneSeeker like this -
In my log I noticed, that the total number of auctions in the API hasn't changed since 6 pm CET when the number first reached 5000 auctions, even though there are clear price fluctuations visible for most cards since then.
So I wanted to ask if the number of auctions that the api responds with is capped at 5000, or if this is just some extreme coincidence? Thanks.
-
1 hour ago, MephistoRoss said:
Nice work.
One small suggestion: When looking at a card page, could you add the name of the card to the title of the page?
So when you have multiple tabs open in your browser, you know which is which.
Of course it would be even nicer if everyone could make his/her own list of cards to follow and view a summary of the list prices on one page.
Thanks and the Title suggestion is a great idea and one that I can easily implement.
The idea of a favorite list is something that I played around with as well, maybe in combination with other features that I thought of which would be quite easy with a log in feature, but that's for after the overhaul.
Edit: The Titles of the pages are now the respective Names of the pages.
MephistoRoss likes this -
4 hours ago, Mynoduesp said:
A determined layout for mobile users would be nice to have. Not sure how many would use the site on mobile, but I saw some potential for improvements when I checked it out on mobile. ^^
what exectly do you mean by determined layout? As in a different display compare to the normal website?
Also, I thought of maybe writing a mobile app for the site, but that is something far in the future, when the site provides enough features to justify creating an app for it. xD
-
Good news everyone, the site now displays the actual recorded minimum buyout prices!
The relevant data is automatically added to the database every whole 20 minutes.
As I mentioned before, the site only displays the minimum buyout prices, as that was the system I put in place in the beginning. I am currently working on completely overhauling the site to allow for a more detailed view of price history and development, so stay tuned.
And don't worry I am saving the momentary api data on a separate database to allow for the overhauled site to process the data retrospectively.
I hope you all will find this helpful and please let me know your feedback.
fiki574, Mynoduesp, Metagross31 and 1 other like this -
This is so amazing.
Thank you all so much for allowing the community to be even more involved in the amazing work you all have done.
With this I can finally expand my project and create the site that I envisioned. Again, thanks so much!
fiki574, Maxxxel, RuneSeeker and 1 other like this -
13 minutes ago, Ladadoos said:
@Maze You might be interested in this
Yeah I just saw it.
So hyped to get into it.
Skylords Marketplace Journal (SMJ)
in Development
Posted
It is definitely the device... for some reason it stops running the scripts without technically stopping them, if another application was focused...
Well, I guess that's the price you pay when using a cheap old tablet/notebook that isn't really good for anything and that I had lying around...
I will try to switch to something reliable as soon as I can...