User post / discussion history import

Good day,

How would one go about importing post and discussion history into a UNA?  I would like to move my historical social media (twitter, facebook) posts over to my UNA install.  I have raw data in JSON and CSV.  Now, is there a module that allows for a data import based on these formats or another?  Will I have to dig into the DB structure of UNA and do a lot of database manipulation to accomplish this?  

Any pointers are greatly appreciated!

  • View
    529
  • More
Replies (7)

    • O

      Has no one attempted this?  I reached out to the developers and haven't received a response, either.

      • That sound interesting. It will be helpful for some of us that are trying to get away from fb and other big corps, and to give a good start on a una niche. 😊 

        • O

          I've reached out to the UNA team requesting information on cost and speed to which this could be developed.

          I've also posted a project for this on some freelancer sites in the event the UNA team response is not favorable.

          • Hello omaticon !

            It seems that our answers from the 25th and 28th of January didn't reach you. So in commonly it depends on the structure of exported data. You may put it to the separate tables in your UNA database, but then it will require you to write the MySQL export queries or even the migrated script to place this data in any UNA application.

            • B

              I think lots more people would leave FB if they realize they can take their data and move it to a new service. 

              m working on this now. For the FB JSON, Here is what I see so far:

              Read each JSON row

              1. each entry will have to be dumped bx_posts_posts table, and then each photo matching that file 

              2. read the last ID number in the bx_posts_photos table

              3. write the values for the photos, store the photos in the file system

              4. write the post data to the posts table

              Somewhere there should be a join table that joins the photos with the posts. I am still looking for it. I am also trying to find the table where the passwords are kept because I decided I wanted a watch folder on the server for each user because those FB dumps are HUGE. And it will just cron the data in the middle of the night so it doesn't ti up the server at the busiest times. SO, I will have a little sub site where the user enters their email address and password, uploads their zip files downloaded from FB, and it will process. (my profile data from FB takes 4 zip files at 3-4GB each!)

              Does anyone want to collaborate on this with me?

              I am also thinking about to do with the comments. I think I will add them under a dummy ID number, but include the original user's name in the beginning of the comment.

              Write me on Whatsapp or Telegram if you want to collaborate on this. I could use some help, although it shouldn't be too hard.

              John

              +7 903 220 0175

              • B

                 far as I can tell, in the bx_posts_photos, remote_id is a hash of the file. Then the directory is the first character, then the first two characters, then the first three characters of the hash... and then the hash. to save database space and use when checking for duplicates? Because the photo isn't actually stored there. I have no idea where it is. Anyone know? I have tried finding the file name in the file system but it's not there.

                • O

                  Leonid,

                  I'll search my spam filter but, I hadn't seen responses from UNA.  Would it be possible to use the API to perform this task?  I sent you all two e-mails at support@una.io inquiring as to cost and time it would take for you guys to develop this.  I hadn't seen a response to those e-mails.  Let me know if you had responded and I'll check my mail filter.  However, your prior support e-mails have come through without issue.

                  Login or Join to comment.